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. ..CHAPTER I . • 

' ' INTRODUCTION 
What is PQE? • • ' ^ / 

Program Quality Evaluation (Pqq.is the measurement of how individuals 
perceive the quality and effectiveness your spec4al education programs. It 
answers some'^f the questions that educators and, the public \have been asking. 

. Is the special education program effective?- • 

. Are's'pecijl needs phildren learning academics and skills? 

. Which parts of the special e^lucation program are excellent and . 
which are satisfactory? 

A numberof people know the answers to these questions for ydur" local 
education agency (LEA). School staff certainly know a great deal about the 
quality of the programs, as do the parents of special n.eeds children and the . 
children themselves. The professionals who record indivi|kial student. progress 
also have answer's. The key here is to combine what they individually know 
intoya total Program Quality Evaluation. This manual shows the LEA evaluation 

coo^rdinator how to collect information, produce a report and take actioft ' 

• r ■' ' ' 

Selecting an Evaluator 

— : — ^ " ^ •. - ... ■ . , . 

* ..... 

•y • ■ 

.Detenaination of who should be selected as the LEA evaluation coordinator 
•is Teft to the LEA. In many cases, a professional from the support services 
staff versed, in evaluation and measurement might serve as the coordinator. • 
The process also can be enhanced by an active, knowledgeable advisory committee 
which could provide guidance and direction. * 
The Evaluation Cycle ' . * 

: To allow sufficient time for the LEA to Implement action plans and 
demonstrate progress toward Identified goal'areas, the special educati 



Pr-oqcam Quality Evaluation should tie conducted every three to five years. 
The teamwork of the State Education Agency (SEA) and LEA evaluators is an 
ntegral part of. the 'process. ' 
The Ev aluation Process " . 

• Th.is manual was developed for use by the LEA evaluation coordinator with 

the assistance of the SEA Regional Coordinator. Because it is'' believed that 

■ I ■ ■ ■ 

LE As have the desire and-capability to conduct Program Quality Evaluation,' 

■ «r ■ • 

this manual has 'been developed with the LEA ^evaluation coordinator serving 
a critical roTe. . * * 

The'SEA regional coordinator's function in one of initial training and" on 
going support,' It is the job of 'the LEA evaluator to coordinate the project, 

.... . ' m 

gather and analyze-data, generate a report and establish a viable plan of 
action. . 

The process of conducting .a, special education Program Quality Evaluations 
can be done over approxipiately three and .one-half months if the LEA uses 
the following timeline: ' A 

^l^Sl , . During Week No. ' 

• ' 

1. LEA selects an evaluation coordinator ' . • ' * 0 (Start) 
to conduct the Program Quality Evaluation 

and to serve as liaison with the SEA. - 

2, Evaluation coordinator prepares for the 
l^ro§ram Quality Evaluation (with technical 

assistance as necessary from the SEA Al 
Regiofm+^oordinator). 1 

a) studies Program Quality Evaluation Manual 2^ , 

b) selects sample 3 
** c) copies instruments - . 3 

d) selects and trains fojder reviewers 4 & 5 ' 

e) gathers existinj^L^A data ,fpr Instrument h' * 5 • 



\ 
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f) distributes surveys ■ ■ . 

g) collects Purveys and follows up on ' . m 
nonrespondents 

* h) submits SG^n. sheets for computer i? 
tallyrng , 

% ' 

3. Evaluation coordinator int^ferprets the results 
writes the report and formulates the manage- ' 
ment plan. * iii««iayc 

4. Evaluation coordinator determines which if 
any. self study issues (Instrument tt) will 
be^ examined over the course of the next year. 14s , 

Total of 14 weeks 

Units of Analysis * ^ 

In order for evaluation data to have any meaning. It must be organized 
in some reasonable manner. A determination must be made before the Instruments 
are developed as to how the data will be reported. -Any number of variables 
, c.n be included in information gathering to be used later for analyzing 
results. For example, name of school, age. sex and ethnicity are all student 
variables which would produce interesting analyses either inVconJunction - 
with each other or individually. 

For the purpose of this manual, three "units of analysis" have been 
Chosen:, area of primary exceptionality (I.e., the student's diagnosed major 
handicap), student settings (i'.e. , the student's cl^sroon placement on 
continuum from regular education/Indirect special education to home/hospital ^ 
placement), and educational' level (i.e., elementary, grades k-S or secondary, 
grades 9 Jl.: Table shells (blank tables) ^or reporting the <^ta are organized 
using th^^unUs of analysis. 

It Is Important to idenM^y all the ways in whieh data will be analyzed 
early in the process so th/t the right' infonnatlon Hs requested at the ti'me 
of evaluation. An LEA's access to a'computer might.be a deciding factor in 
j:he number of ways data are reported. The time burden consideration Vor 
respondents should be another. ~- 



An Overvievf of thy Manual 

' Thi^ manuabj^ designed to assUt UA administrators, working in conjunction 
with SEA Regional Coordinators, ^to find answers about .the quality of their 
special education programs. The clear, st6p-»by-step format of each chapter 
allows the evaluator to work in a systematic manner to examine components of 
the special education program for indicatoi»s of quality. 

Chapter II establishes the purpose of. conducting this, or'any, ev^iluation 
in order to 'provide the evaluator with the basic underlying assumptions inherent 
in;the process. The PQE Manual employs a goal-based evaluation approach. ' 

Chapter III sets forth program goal areas^and accompanyi-ng objectives as 
■ the major f(^cdl points for an investigation of quality using, a goal -based model. 
While t(f»^ evaluator may choose to develop goals specific to'the LEA, the advan- 
tages of such tailoring appear to be outweighed by the disadvantages in time 
and effort expended. Further, ^Chapter IV provides the evaluation questions 
which have been derived frOm the goal areas and objectives. An explanation of 
criterion levels is also included to enable the evaluator to set standards 
against which program quality will be measured. • . 

Keeping efficiency and effectiveness in mind, Chapter,,V overviews various. 
methods for collecting^ data for each evaluation question. Throughout the . 
process, it is important to strike a balance which would emphasize good evtilu- 
ation practice wit^.a minTynum of time and paperwork burden. Cjiapter VI described 
methods for sampling' to be used which wiTl address both points. Sampling plan 
• table shells are included in Appendix A tq^ establish appV-opriate sample sizes 
for each data source. 

Chapter VII describes the instrumentat^bn used in gatjj^ering the actual 
evaluation data. The instruments are included in Appendix -B as c^imera-ready 
copy for priYiting or photocopying for distribution and use* , 



' Analyzing the data and reporting the results are detailed in Ch&pter VlII. 
Table^shells for organizing results and expediting report preparatio/i are con- 
tained in Appendix C. * • . ' - » ^' 

finally,* Chapter IX .instructs the evaluator in developing a management ^pl an 
whi^h is responsive to the findings of the program quality evaluation and is. 
iK.tical. * ' . ' , - . ' * 

t)efinftion of Terms ^ . ' ' . 

' It is ijnportant to ensure a common' understanding of some, of the terms .to be 

used regularly throughout the manual. As used here, the term special education 
^ . » ■ ^ — 

program refers to the- total LEA system by which students receive ^s pec ia^My * 
designed instruction within different placement settings on the continuum. 'The 
program, then, is used to "encompass all of special, education in an LEA, 

^ Evaluation is a word with a number of meanings to educators. Here it i^ 
important to draw the distinction between, evaluations used to measure individual 
staderil^r^gress and a program Quality Evaluation with which an LEA determines 
the exte^nt to which program goals. and objectives are being met. The latter^ 

definition is used in Program Quality Evaluation. 

■ '"■'*-.. 

An additional clarification should be added to emphasize the difference . 

* ' , . . . 

between the special educatioir Program Quality Evaluation and compliance moni- 
toring. The focus on monitoring is the determination of compliance with laws 
and regulations. The focus of this evaluation Js the extent to which program 
goals |ind objectives are being met.,.. are students benef i ting- froiti special 
education? 



' • ■ > ^ CHAPTER 11, • ^ * 

■ ' PURPOSE OF PROGRAM QUALITY EVALUi^TION • ^ . • • 

• ■ ■ > 

• Local improvement of program qqility, public information, and state plan- * 

rhng'and-palfcy development are three reasons that a Program Quality Evaluation" - 

' * Y " 

needs to be conducted far each LEA. Special education has grown substantially 
in terms 6f its scope, 'cost and complexity during the past decade.' The North 
Carolina Department of Public instructiorv-is exercising its leadership function 
by providing a vehicle for the critiflfeil; sfrfalysis of these essen*tiaV..pro^rams- 
and services. " ' * * ' ' * ^ 

Local Improvement of Program Quality ' . 

Overall, educators feel reasonably sure that special education programs, are 
benefiting students. All students ha\^e Individualized Education Programs (iEI^'s), 

• ■ # 

substantial resources are directed toward implementing these lEPs, and a host of 
procedural safeguards provide^minimum procedures that must be used in the deci-- 

.sipn-making process for each child. Now information is needed that goes beyond 
compliance. Issues to address program quality. " As an example^ it is no*' enough 
to know that many students have reading objectives in tbeir lEPs and that these/ 
lEPs ar^reviewed In accordance with mandates. School administrators want to 
know if students are learning to read cornnensurate with their ability and handi- 
cap. Administrators al^ need to know if the student assessment process places 

^students In the most appropriate program and p|rovides useful information for the 
teaching of reading. ; * * 

LQcai Public Information • . 

\ ■■■ ■■ . ■ . > . ■ ■' ■. . ■ . 

VPJf'pg'^an^ evaluation resMlts are" useful in public information efforts. Such 

/evaluation results provide a constructive arena for discussion that centers • 

around helping children. This t^pe of discussion leads to genuine, lasting 

• ■ • »\ ■ ." "; '. - , ■ . . . ■ , ■. ■ '• 

support from a community J Everyone, Including parents of children with special 
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. nedds. must see program-outcomes; , These dutcomes ar^'among' the reasons people 
have worked for special ed«»ation mandates and fundlhg over the years After 
prograiri access.. issues have' been mpt through basic compfiance. program quality 
i9-^he center of parental concern. ' ' 

' -Support for programs must be squght from the geoLl public as well as from- 
parents of ehildrej^- with special needs. Responsible support from public. can 
be expected when the f)rogr?m in question has been sho^ to be effective". More-, 
over, when a systematic sludy shows a .portion of the program to be in need of^. 
attention, better ar^guments ^also can be made for increased program support. ' 
^tatj^^an ninq and Policy Development ' 

:an be done by the SEA as the' result of special education program 
' eval^^tion. Planning for such areas as grants. 'technical assistance, and staff 
^Jevelopme^t wi.ll be greatly advanced by detailed knowledge of program quality. 
Needs assessment becomes muchmore direct with the inclusion of program evalu- 
.ation data. • . . 

Policy development in the administrative and legislative branches is enhanced 
by program evaluation resul*t^^ggregated across the LEAs. State policy makers 
need to know the effects of . the substantial sums of money spent on special 
^education in North Carolina each year. 

Finally, the long-term benefits of statewide data collection should be noted.' 
The SEA ..is collecting both student and program data with Program Quality Evalu- . 
ation to produce report5 regarding spepial need student achievement norms and 
special education programmatic effects. 



CH/\PJER-in. . 
PROGRAM tlOAL AREAS AND^OBJECTIVES 

' Using a gojl -based program 6valuaTldn model presupposes the existence of. 
program goals. While It is recognized *that local needs would dictate parti- 
cular areas of emphasis? within some broadly stated areas, there are some goals 
which pertain to all LEAs in defining direction for their special education 
programs. * • 

The three goal areas defin^ in the manual address those broafd areas for 
the purpose of examining quality. The general areas of Determining Learner - 
Gains/Outcomes .. Locating and Evaluating Learners and Placing Learners Appro- 
priately allow for a thorough analysis of how well an LEA's- special education 
program is working. These goal areas were developed for this process using the 
requirements of statute and/or regulation and the good practices that define 
program quality beyond compliance. These goals and accompanying objectives are 
not Intended. to be mandates .or standards and should not be construed or used as 
such. 

Another consideration in the generation- of goal areas and accompanying * 
objectives was that of administrative burden (I.e., as more goals are created, 
more objectiv^ are necessary, along with more evaluation questions and so on). 

balance must be achieved between the number of goals necessary to define the 
direction of the evaluation and the amount/ of time and paperwork required on 
a total LEA basis to measure effectively the implementation of program goals. 

The broad goal areas which follow represent the Intent of North Carolina 
LEAs with regard to program quality. _ * 



• SPECIAL EDUCATION PROGRAM QUALITY" EVALUATION 

' GOAL Ar'eAS ■ \ " 

>■ ^ . ■ • ' ^ . ■ ■ ■ ■ ■ ■ * 

North Carolina local school administrative units should strive to achieve 
quality education for special needs lea;-ners 1n the three following goal areas 



^ • De termining Learner Gains/Outcomes 

Students Vvi 11 n^e satisfactory progress in th^ specific 
curriculum area? in which they are enrolled and develop 
a positive self-image for learning and work. 

2. Locatin9 Evaluating Learners 

. , Students between the ages of 5 thru 18 who may be in ^ 
need of special education programmi.ng^will be located 
and evaluated. " ' 

3. Placing Learners Appropriately 

Students will be placed in an appropriate program ' 
consistent with their assessed .educational needs kn6 
with consideration for placement in the least restric-* 
tive environment. 
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This section presents the program objectives' related to th^se 



areas: 



> * 



PROGRAM OBJECTIVES 



Goal 1 



Students will make satisfactory progress in the specific 
curriculum areas in which they are enrolled and develop 
a positive self-image for learning and work. 



1.1 Students sijccessfully demonstrate competencies in appropriate 'curriculum 
areas^at level| commensurate with ability and handicapping condition. 

^•2 Positive work labits are developed in the course of the students' edu- . 
cation programs. ' ■ - " 

1.3 The special Education progcam effectively contr^ibutes to the development / 
of student's positive attitude toward self and others. ' . ^ f 

1.4 The specia/F education program effectively contributes to the student's 
desire to learn. 



Goal 2: Students between the ages of 5 thru 18 who may be in need 
of special education programming will be Tocated and 
evaluated. . " 



2.1 The referral and screening ef/forts that lead to evaluation of children /^x 
who may need special eijlqcation are thorough and systematic . 

2.2 Evaluations and re-evaluati(4s adequately address posjible needs identified 
in the referral. V 

2.3 Techniques used in conducting screening, evaluations and re-evaluations are 
appropriate . 

2.4 Evaluation arrd re-evaluations provide cl|ar, relev/nt educational infor- 
mation sufficient for determining eligTBTTTty: — ' 



2.5 The reappraisal of the effectiveness of educational programming and place- 
ment at the annual review is constructive. 



Goal 3: Students will be placed in an appropriate program consis- 
tent with their assessed educational needs and with consid- 
.. eration for placemen^ in the least restrictive environment. 



3.1 Individualized Education Programs are comprised of elements" appropriate to 
the assessed needs and levels of performance of learners. 



' ^h^^^"^ict^dev^Cl^i.""'^ ^^"^^"^-^ regu^r programs ^hances 
S:i;"^Ju"i??onaVdT;:?;:^^^ ^" ^^^"^^^ programs *^n|^ , 

I^pn^fV! ^41^ participants in decision ma kinV regarding the pUce 
^ent and edu^itTonal planning for their.children. ^''^^^^a pia.ce 
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CHAPTER IV 
EVALUATION QUESTIONS AND CRITERIA 

The evaluation questions listed in t'his chapter are derived from the goal 
areas and program objectives specified in Chaj?ter III. Evaluation questions 
'provide a link between program objectives and the instrument items to be used 
in collecting evaluation data. It is important that evaluation questions be 
as clear as possible and focus on the quality of programs rather than on com- 

pi lance. . ' ' - ' 

The following evaluation questions are numbered using, the corresponding 
program objective number with an additional digit. For example, the first 
evaluation question to stem from program objective 1.1 is 
. V EVALUATION QUESTIONS* 



numbered 1.1.1. 



1.1.1 Are reading competencies attained commensurate with students' abilities 
and handicapping conditions? 

1.1.2 Are language arts competencies attained commensurate with students' « 
abilities and handicapping conditions? 

■" * . • ^ 

1.1.3 Are math competencies attained commensurate with students' abilities 
and handicapping conditions? ; 

1J.4 Are vocational competencies attained cofnmensurate with students' abilities 
and handicapping conditions? 

1.1.5 Are science competencies attained commensurate with students' abilities 
and handicapping ^conditions? 

1.1.6 Are social studies competencies attained commensurate with students' 
abilities and handicapping conditions? 

1.1.7 * Are cultural arts competencies attained commensur^ with students' 
. abilities and handicapping conditions? 

1.1.8 Are competencies for healthful living attained commensurate with students' 
abilities and handicapping conditions? 

. Self-Help Skills/Life Skills . 
; Physical Education/Health Education 

1.2.1 Does the special education contribute to the development of students' . 
positive work habits? . ' 



^■"■^ tolefc ^•'"""o" P'-oa™ contribute to students^ desire 

?Ke'e:atl?o'?'X"ce?s1°'',;'' '"^^'''"'^''^ "edslon- .aking in 

K4:3^^p^^el;^;^:-a^i^ 

Ahe-all needs identified In referrals addressed by evaluation techniques?. 
Do the techniques used Ifi conducting evaluat1ons/re-evaluaHr,n, 
^nto^account such student cons1der.?,ons aB^4":'5?sa^?l??y?a"nd*;;a1lve 



2.1.1 
2.1.2 
2.1.3 
2.1.4 
2.1.5 
2.1.6 
2.2.1 
2.3.1 



2.3.2 
2.3.3 

2,4.1 

2.4.2 

2;4.3*' 

2,4.4 



l£0 



2.5.1 Do the annual reviews thoroughly examine such information as evaluatlorv 
data.. Individualized Education Programs, and teacher reports? 

2.5.2 Do the annual reviews thoroughly examine studints' continuing eligi- 
bility for special education? 

2.5.3 Do the annual reviews thoroughly examine t;^e ne.ed for changes in students' 
instructional services? 

2.5*.4 Do ther annual reviews thoroughly examine the continued appropriateness; 
of students' related services? ^ . . 

2.5.5 Do the annual reviews thoroughly examine t-he continued appropriateness 
of students' placements? . * 

3.1J Are the Individualized Education Program statements*of present level of 
performance derived from actual assessment data? 

3.1.2 Ard the Individualized Education Program annual goals Nand short-term 
objectives based on identified needs? . > 

3.1.3 Are the evaluation criteria in Individualized Education Program objectives 
Clear and usable? ■ ■ ■ . , 

3.1.4 Are the appropriate types of regular education provided! considering 
assessment data? ^ 

3.1.5 Are the appropriate types of special education provided, considering 
assessment data? - " - * 

3-.1.6 Are the appropriate types of related services provided, considering 
assessment data? 

3.1.7 Are the appropriate types of vocational education services provided,Jj|jf 
considering assessment data? - ^ 

3.1.8 Are the appropriate amounts of regular education provided, considering 
assessment data? ^ • 

3.1.9 Are the appropriate amounts of special education provided, considering 
assessment data? 

^ . i . 

3.1.10 Are the appropriate amounts of related services iprovided, considering 

assessment data. 

3.1.11 Are the appropriate amounts of vocational education services provide<^ 
considering assessment data? . 

3.2.1 Do students included in regular education programs benefit socially? 

3.3.1 Do students -Included in regular education programs benefit academically? 

3.4.1 Are the communications from the school to parein;ts conducive to building 
positive relationships? '* ' 



??og?:sr5?lLrr'?h.?Yd"4T"' contact w,th parents regarding \ 

3.4.4 ,. Is all infonnation supplied by parents considered In; decision ,™king7 " 
Criteria • . 

^ Two views of criteria can be applied to this evaluation ™odel. The first 
andVrhaps ™re ^aningful, is found in the descriptive te^ns wiihin the evalV 
ation questions.' For example, question 1.1.1 includes the phrase "co™,e'^surate 
with students' abilities and handicapping conditions." This defines, insofar : 
as possible, the level of expecta.^ion the evaluator holds for the program in 
the area of reading. > 

This descriptive view of criteria should be supplenented with a numerical 
standard such as "percentag; satisfactory." Thus, a program objective can be 
Viewed as.being satisfactorily attained for 75% of the Special education students, 
or meeting a 7M criteria. Such numerical criteria are to some extent arbitrary. 
After the LEA completes its first program evaluation, it will be better able to 
set benchmarks for subsequent attainn^nt. This longitudinal approach is recom- 
mended for the setting of numerical criteria. ' 

A few words should be noted about product and process Objectives. The 
numerical expectation for' process objectives «hould generally be higher th.n for 
product Objectives in this model. It would not be unreasonable to expect, for . 
example, a 96* to 100% satisfactory fate r^gardipg the thoroughness of annual •, , 
revia^s (Evaluation Ouestions 2.5.1 - 2.5.^). it Wght not be possible, however. • 
to attain ,00% satisfactory progress with students/in reading (Evaluation Question 
1.1.1); few educational programs make satisfactory progress with all students. 



Ov«r the coming years, the SEA plans to assist in the judgment of satis- 
factory progress through appHe.d research.^ Data submitted to the SEA ca\^ be 
analyzed to formulate progress norms by exceptionality and program, so as to 
better evaluate program success in the future. - 
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METHODS. FOR COLLECTING DATA 

Sources for collecting data to answer evaluation questions are as nume,x>us 
and varied as there are people and records In an. LEA and as-c?il?w?a^he , 
evaluator conducting the project. It is tempting ^o seek answers In reji 
earners of .students' records, to ask everjone In sight or to gen^te enough 
sjveys to keep , the ^valuator tabulating returns long after they had relevance. 
H/wever, it is Important to keep in mind the reasonable balance discussed " 
earlier, a balance between validity and response burden. •, 
Each possible source of data c'annot be tapped, alttough such an a 




would yield the highest validity. It is necessary to consider each et^on ' 
questiW within the framework of all the .questions so as to.develop an approach 
»(h1ch is systematic and thorough, yei; efficient. i 

This manuaj sets forth such a systematic, thorough approach. The data 
collection strategies employed will pV-ovide an eva-luJtor who also performs other 
Jobs with sufficient infom«tion to liake useful and Valid Judgments about the 
progress of the LEA toward the attainment of program quality. 
^ The followlng'instruments have been .'developed as Wlhods for collecting ' 



data: ' ^ 



A) Student Record Review ' 

B) . Parent Survey ■ ^ 

C) Special Education Teacher Survey 

D) Regular Education' Teacher Survey ^ ''^.^ - ' 

E) Related Services Staff Survey 

F) Administrator Survey * / • . . 
Gj Student Survey ' M ■ 

■ 2p*^^^^^ Procedures to Obtain Additional Informatian 

for Selected Program Evaluation Questions. V • mtormatlon 

An Index of evaluation questions and the corresponding data collection 
strategies is presented In Figure 1, 



Figure 1. CroSs reference 0/ evaluation questions and instruments. 
INSTRUMENTS: 

A. Student .Record Review 

B. Parent Survey 



C. S4)ecial Education Teacher 
Survey 

D. Regular Education Tteacher 
Survey 



E. Related Services Staff 
Survey 



F. Administrator Survey 
6, Student" Survey 
H. Self Study 
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SAMPLE StliECTlON ^ 



'! student and'l?ar^ent Sarnffi^^^ . * 

. The:evjl^,>^^ will find it n*:essa ry to use sampling pro- 

, cedures for distribution of th^ student and parent surveys and selection of 
, sfeutet records for review.'' This section will describe a sampling procedure 
.. .Mie^l upon the number of special needs students (excluding gifted and talented) . 
: in .various exceptionalities. Student settings and educational levels (elemen- 
tary fop. grades K-8.,^rid secondary for grades 9-12). Oncf the students have 
^^been identified, the parent sample 'is also completed. as it consists of the 
parents of the stutJent Mmp+o. 

The goal of tHe sampling strategy is to represent the overall LEA prog ram 
in the evaluation •proc:ess. >s such, the |ampling strategy must first identify 
sampfling categories (exceptionalities, student settings and educational levels). 
Following this, the approximate number of special needs students i« each (Ategory 
must be determined and used in conjunction with the selected minimurn sample size 
to determine the actual number of students in each category.- The process is not 
complex and should result in a sample that reasonably represents the composition 
of the LEA program. ^ . . 

It should be noted, however, that the sample sizes suggested are minimum 
sizes seleclecl "^educe -the burden of the evaluation to the LEA. If random 
sampling techniques are 'employed, the 'minimum SAjggested saifTpleHize and sampling 
^ strategy VwiU yifeld representative samples that take a,, jtescriptive "picture" of 

• ■ .... - ■ Vv^ftif.. . f 

the LEA. Because these ^a re minimum sample sizes, sta|1itica\i tes.ts regarding 
comparisons of responses across sanjpling categories may not b? valid.* With 
this in mind,*th6 st4ident/parent sampling plan dan be developed fpr program • 
evaluation. " 
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Determining Survey and Record Review Sample Sizes 

The sample sizes fol^ the Student Survey, Parent Survey and the -Student 
Record Review should >e based on the number of special needs students (excluding 
gifted and talented) In the LEA. The first step Is to select a reasonable 
target sample size, keeping the logistics of survey distribution and follow-up 
In mind. The following chart will serve as a guide for initial sample size 
selection for both the student and parent" samples/ 



Total Number 'Of 
Special Needs Students 
In the LEA 



Minimum Number 
of Students/Parents 
for the Sample 



/ 



Less than 100 

100-300 

301.-500 
• b.O^-m * ' 
*^ 701 -900 

901-1100 

1101-1300 
, 1301-1500 

1501 ->l 700 ^ 

i7oi-i90a • 

1901-2100 
' over 2100 



■IP 



50 
60 
70 
80 
' 90 
100 
110 
120 
130 
140 
150 
175 



Figure 2. Minimum s tudent/ pa ren t iample sizes 
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. . . . . ^ 

It-Should be noted, again, that these sample sizes are suggested in light ^ 
^ of the burden associated with the collection of data. By following the steps 
outlined below for* selecting the sample., the evaluation will be conducted on a 
sample size ^justifiable on the basis of random selection within each of the 
sampling categories. . 

After selecting the initial minimum sample size, there must be consideration 
Of how these students (parents) wi 11^ be distributed across the various excep- - 
• tionalitJes. student settings, and education levels (elementary/secondary). The 
example table shells presented on page's 25-28 include>the possible exceptional iti 
and student settings for the LEA. They also include data for a hypothetical 
■program in which the sample of learning disabled students has been selected. 
First, review the eight steps presented in ^he next section and the completed 
example at the bottom of ""each sheH. Then use the blank table shells included 
in Appendix A to select your sample. Note that these steps are repeated at the 
bottom of the table shells. 

Samplinq Steps ^ , * 

1. Determine the minimum number of students to be included in the survey 
(see Figure 2). ; 

2. Divide this number by the number of special needs students (excluding 
gifted arid talented) in your LEA to obtain a sampling proportion.*^ 

3. Complete Table Shell #1 by listing the number of students in each excep- 
tionality and student setting. . 

4. Multiply the number of students in each eel Tb^ the s.ampling proportion, 
rounc^ decimals over 0.5 upward and enter the resulting, numbers in the 



Table Shell #2. 



5, Using the separate exceptionality row totals in Table Shell #1, divide the 
number of special needs students grades K-S (elementary) by the total number 
of special needs students in each respective exceptionality to obtain the 
•proportion of elementary students in each exceptionality. 

• 29 . . 



6. To compute the,.numbers of elen^ntar^ students In the sample, multiply the 
numbers of elenentary students In each exceptionality in Table Shell #2 by 
this Hidex and ,nter the resulting number In T^ble Shell #3 in the- "elemen- • 
tary" row for each exceptionality (remember to round decimals over 0.5 
. upward), ' , 

<7. To compute the numbers of secondary students in the sample, subtract the ' 
celt entries in the elementary row In Table Shell #3 from the corresponding 
cell entries in Table Shell #2. It may be" difficult to distribute numbers 
to some cells as the numbers in some areas can be very small. Remember 
^ these are merely approximate numbers which can be adjusted at your discretion 
■Note that in the example on th^ following pages, the regular>direct and 
self-contained elementary cells received one student each and the secondary 
cells, none, V 

8. Scan the cell entries to be certain to have addressed the intended except 
tionalltles. student settings, and educational levels. Check to see that 
except|owl1ty row totals in Table Shell #3 stilllgree with those in Table 



Shell 



* The s|^e!.ted steps in developing the student/parent sampling plan should 
result 1n ||,4le representative of the LEA. If some areas do not appear to be 
properly represented or it Is desirable to delete some exceptionalities or student 
settings, adjustments in the sampling plan may be needed. Some LEAs my wish to 
Increase the number of students in the sample so that comparlsikns at the "cell"' 
level are possible. Reference to example Table Shell #3 for the hypothetical ' 
program will illustrate this point. Givin that several dells in the sampling ' 
matrix contain only one student, it would be inadvisable to compare data at the" 
cell level as such comparison could lead to inaccurate conclusions.' It is 
reconinended that comparisons be made using only the column and row "marginal" 
(subtotals) sample sizes which collapse ac^ss two of the three sampling 
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«tegortes. For example, co^a.i.ons a™,„g the exceptionality areas should be 
™><.e on,, after combining students fr,™ the.student setting and educational 
levels. 

^ ^^^l^^tofexceptlonalltles in the North Carolina Equal Education Oppor- 
' tunity Plan were used in this manual; the abbreviations are: 
AU Autistic 



DB Deaf-Blind 

EH' Behavioral ly/Emotionally J^andicapped 

EM Educable Mentally Handicapped 

HI Hearing Impaired \ 

LD Soecific Learning Disabled 

MU Murti handicapped 

OH Other Health Im^ire^ 

>PG ' Pregnant * 

PH^ Physical ly/Orthopedically Handicapped 
SI Speech-Language Impaired 
SP Severely/Profoundly Mentally Handicapped 
Trainable^Mentally Handicapped 



TM 
VI 



Visually Impaired 

. I. 



V 
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TABLE SHELL n 

♦ 

STUDENT* SETTINGS 




Sampling Steps 



1. 



2. 



3. 



Determine the minimum number 
of students to be included in 
the survey 



Divide this number by the number af 
special needs students •(excluding 
gifted and talented) in the LEA to 
obtain a sample proportion. 

Complete Table Shell -fl by listinq^ 
the number of students in each 
exceptionality setting. 



Examples 

1. This hypothetical distritt has 
• 1000 special education (excluding 

gifted and jtalented) students, 
): so the recqmmended sample size 
is 100. ' 

2,. 100 T 1000 « 0.10 (sampling 
proportion) 



The table shell contains data Vor 
the LD<^rogram area. 



TABLE. SHELL , 
STUDENT SETTINGS 




Sampling Steps 

4. Multiply the number of students in 
each cell of Table Shell #1 by the 
sample proportion, round decimals over 
0.5 up and enter the fesUlting numbers 
» in Table Shell #2. 



5. 



^ Using the separate exceptionality row. 
.totals in Tatole Shell #1, divide the 
number of special needs students qrades 
K>-a (elementary) py the total number 
of speciaT needs studerit$ in e&ch " 
respective' exceptional ity t'd obtain 
the proportion of jlementany sti3ents 
1n'=each exceptibndlit;^,. ' 



Exampl es ' 



4. Regular Indirect: 18 x 0.10 =1 8; 
round to 2. 

Regular Direct: 5 x 0.10 * 0.5; 
round to 1 . ' 
Resource: 182 x 0.10 = 18.2; 
/round to 18. 
etc. 

5. Assume that ther* are 156 LD elemen- 
tary students. Dividing 156 by 

the district LD total of 260 jfsee 
Table Shell #1) (156v260) indicates 
that 0.60 of the district special 
education students (excluding 
. f gifted and talented) are LD. 



TABLE SHELL #3 
FINAL SAMPLING PLAN 
STUDENT SEHINGS 




Sampling Steps ^ 

6. ■ To compute the numbers of elementary 
students in m sample, multiply the 
numbers of students in each excep- 
tionality in Table Shelb#2 by this 
index and ent«r the resulting number 
in Table Shell #3 In the "elementary" 
row for each exceptionality (remember 
to round decimals over 0.5 i^pward). 



Examples ^ ^ 

6. Regular Indirect: 2 x 0.6T) « 1 2- 
round to 1. * 

Regular Direct: 'l .x.0.60 = 0 6- 
round to 1. ' 

Resource: 18 x 0.60 « 10.8; 

round to 11 

etc. 



Sampling Steps 



7. 



Tp compute the numbers of secondary 
.students in the sample, subtract the 
cell entiles In the elementary row in 
Table Shell #3 from the corresponding 
cell entries in Table Shell #2. It may 
be difficult to distribute numbers to 
some cells as the numbers in some areas 
can be very small. Remember these are 
merely approximate numbers whic* can 
be adjusted. (Note that in this 
example, the regular/direct and self 
contained elementary cells received 
one student each and the secondary 
cells, none. ) 



Example 

7. Regular Indirkt: 



Regular Direct: 1 
Resource: ]^^]] 
etc. 



2 - 
- 1 

' 7 



1 « 

= 0 
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Selecting Actual Students and Parent s , 

• Now that a sampling pljan has been developed to represent the LEA, the 
actual students to be included in the survey and foldejf review may be selected. 
The essential task" now is to ensure that this sjelection is done on a random basis. 
The ideal strategy to achieve this is to give each student an identification 

i 

number and consult a random table of numbers to select the actual students. If 
this is not feasible, consider an easier procedure: first obtain an alphabetical 
list of the students in a particular exceptionality area. Then divide the number 
desired in the sample into the total number in the^exceptionality area to yield 
a sampling index (k). Use this index to select every (k)th student on the name 
list. For example, if you want a sample of 10 students from a tol^l of 200 # 
students, divide 10 into 200 yielding a k of 20; simply select every 20th name 
on the list. 

After selecting the student sample, the parent^sample is'also completed as 
they are the parents of the selected students. 
Selecting Regular and Special Teachers 

It is suggested that approximately 50" regular and 50 special teachers be 
included in the survey. If there are fewer than 5aspecial education teachers, 
include all available. For either group with more than 50 teachejrs, a random 
sample can be easily obtained "by dividing the number of staff by 50 to obtain 
the sampling index. Use an alphabetical roster to select the sample; for example 
* if there are 100 teachers, the sampling index i& 2 (100 -''50) and every second y 
teacher would be Included. Though a further Check may be done to determine that 
th6 correct proper t|pn of elementary to' secondary teachers is obtained, the 
abdve procedure should r||ult In a close representation of the staff.- 
Selecting Related Services Staff and Administrators ^ 

Admij^ister the survey to all related service staff and all building admin- 
istrators. . • V 



CHAPTER VII 
INSTRUMENTATION • . 

Surveys have been developed to obtain information from individuals in 
various roles in"^the LEA. Additional data from student records and existing 
LEA data are also examined and all questions are addressed in more than ohe 
instrument «^s a val idity check. ^ 

Once the respondents are selected, a systematic method for the distri- 
bution of instruments and the collection of data should be developed. Following 
up incomplete respqnses and unreturned ilitstruments is essential. 

The instruments discussed in this chapter are^designed to answer the evalu- 
ation questions^ delineated in Chapter IV. A full set of instruments is included 
fn Appendix B, camera-ready for printing or photocopying. These instruments 
are: 

Student Record Review (Instrument A) , 

The Student Record Review process requires an in-depth review of all 
documents pertaining to a particular student. Because these may have been 
generated at different times by different individuals, they may be in several 
locations. Since these records contain longitudinal information, -they should be 
an accurate appraisal of program effect. As an adjunct to survey data, the review 
serves to validate the results of the other, instruments as well as to provide 
information that may not be available to individual respondents. 

The review of student records requires professional judgment concerning 
each of the evaluation areas. A decision of quality, bas^^njpop the evaluatOr's 
interpratation of information found in each file Is necessary. 

Individuals selected to conduct the records reviewjmust have a thorough ^ 
knowledge of special education in order td Identify and evaluate ttjp necessary 

♦ • ■ 

documentation elements. The need for these evaluators to remain objective and 
maintain the confidentiality lof infonnatlon must be stressed. | 



Parent Survey (Instrumgnt r) . . ' .' 

The Parent Sur4y has been designed t<i obtain parental views regarding ' 
their child's school program. . , 

Parent"^stionna1res will most probably-be distributed by mall. Enough 
time should be allowed for the re^rn of information ^nd to follow up on unre- 
turned surveys. The Jnclusion of a stamped, self-addressed envelope will • 
increase the number Of respondents. ^ 
It is suggested that LEAs provide parents with a public information notice 
prior to the evaluation to prevent misunderstandings about the process. In 
addition to a general notice, some LEAs may choose to send another notice with 
the surveys. An example follows: ' * > 

NOTICE ' I ' 

n^In -c schools evaluate the quality 

Of our Spectal Education program to improve its 
effectiveness. You may be asked to complete a — 
survey to help us. Your responses will be kept 

nnrlocfc ^'Ji'"^ "5?^ ""^^ P^°9ram evaluation 
purposes. Please direct questions^ regarding 
this program to: ^ " ^ 

1 — '-^ • 

TSj^iiVi^i"?^^!"" i^^^^^g'^' Regular Education Teac hPr, Related Services St;,ff 
a^d Aaminlstra tor Surveys (HittfSH- ts C. D. E. and F) services Staff . 

In order to provide a comprehensive review of program quality, surveys ihave 
been developed for special education teachers\ regular education teachers, related 
services staff and administflhgrs. These instruments shoul^cf'be distributed by- 
internal LEA procedures with a follow-up of all unreturned questionnaires ) 

^.is suggested that partictpating personnel also receive a notice regard- 
ing the evaluation purpose. The evaluator's ^ffor^s to prevent misunderstandings 
wi;i. increase thte validity of the responses. An example notice follows:. ' 

^Aur}^V — ^ evalVate special 

MrirJSrr ^" °^^!!: *° ^'"P^^ effectiveness, 
'^f#.f^I!f? instruments will be sent^o a random sample 
of^.students, staff and parents as a part of this ef?brt 
Please give careful attention to this survey 

be (^Irected^t^^^^^ 



student Survey (Instrument a) 

. . The Student Survey has been developed to obtain students' /lews of' the 
larograms in which they participate. 

Although many students will require teacher assistance in completing the 
questionnaire, it is important that their responses not be influenced. Students 
^should be informed that the purpose of the survey is to ass\ist in program (not 
individual student) evaluation and that; all responses will be used for thi's ' 
purpose only. 

iinog^^ • 

For LEAi choosing to investigate selected evaluation questions in greater 
detail, procedures to obtain Additional information haye been developed. It 
should be stressed that these activities are- optional and employ a "self-s'tudy" 
approach. In certain situations, these Wedii res may be used as interim evalu- 
ations as well as methods to provide information that' is a copiplement to the 
Program Quality Evaluation. 
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CHAPTER VI ri^ ~ 
ANALYZING DATA AND. REPORTING RESULTS 

In this chapter some suggestions for analyzing the evaluation data are * 
presented. To assist in displaying the data, table shells are provided. . 
Data Analysis . * 

Program evaluation data gathered from t^e various survey instruments can 
be most appropriately displayed using simple descriptive statistics. In almost 
cases, the calculation of frequencies and. more .importantly, percentages 
^will b6 sufficient. In calculatijig these percentages, note that Wy are based 
on individual items/statements from the respective survey forms. The rating 
scale on the survey forms have four categories: E - Excellent; S - Satisfactory; 
U - Unsatisfactory; and NA - Not Applicable. For computer purposes, satisfactory, 
unsatisfactory, and not applicable will be the only responses computed, the 
table shells described later in this chapter collapse the rating scale into two 
primary areas: "satisfactory or better" ("fnore than adequate" and "adequate" 
responses) and "unsatisfactory" ("less than adequate" and "not applicable" 
responses). 

The "not applicable" response is not ^entered into the calculations so the 
number of cases used to determine the percWtages may change for each statement. 
The evaluation coordinator may choose to keep track of a high percentage of_"not 
applicable" responses if. in fact, the respondents should be selecting among the 
other responses. 

^^^^ ^ second person check over at least a sampling of thjB 
calculations, to ensure that computational errors have not been made. A brief - 
tracing of the source of numbers is also worthwhile; some elementary mistakes 
can ruiji otherwise good data. \ * 
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repdrting of scores of Satisfactory %better", allows the LEA to note' 

that sortie responses Indicated that a higher'standard h^d been met. It might. d* • 

• * >. ■ 

helpful to Include information regardint) the percerxtage of "excellent" scores 

for each area, * 

* The actual calculation^ of the percentages can be dorve on a hand calculator 
or by a computer. If a large number of surveys is being 4)rocessed and adequate 
fdcllltles are available, the computer would save computation time. 
Presenting Evalua tion Results 

— : — i ; „ ■ 

The evaluation results: can be best presented by displaying the percentage 

ipf "satisfactory" ratings for each survey statement. To 'facilitate this, separate 

table sheHs are included for displaying percentages by exceptionality, student 

ft 

s*etting and program level (elementary-secondary). I * 

Staff surveys (in9trumer>ts C, D, E, an^, F) are not analyzed by exceptionality 
b'ecause of the ^yross-categorical nature of many special education programs. If, 
•ihowever, an LEA operates categorical programs and wants to collect such data, the 
tabje shells can be expanded to accommodate addUlonal information. No table 

shells ar^ reqiilred for instrument H. . ' 

v.- . ■ 

In developing the evaluation report, the evaluation coordinator is reminded 
that t>ie table shells cart form the basis for the report -findings and recommendations 

I ' • ^ ' * 

J^e evaluation coordinator'should clearly introduce the purpose of- the evaluation, 
,i*ijji4:line the procedures followed, and highlight the findings in a manner appro- 
priate to the particular audience. A suggested outline for a thorough final ' 
report appears' on page 40. 

Evaluation coordinators also shofUld note that alternative reportirtg Wrmats 
could be developed. Some writers may choose to present the results with table 
shells organized as follows: , ^ 

- 1. program goal and objective . 

evaluation question number ^ • " 

3. V comparisons of the s?ame item across instrufnents 



4. respondent group ♦ • 

5. school site 

The reporting style should be ^selected care^lly aftSr thinking through the 
information needs'of the intended audience and their ability to' synthesize infor- 
mation during the j^esentatiol. Summaries highlighting the findings will be of 
great value since simply displaying tables of data might prove to betery con- 
fusing. • M 

• • • 

. Table Shells . Appendix C contains suggested table shells appropriate for 
displaying the data^^ generated in the evaluation. The completed table shells . 
can form the basis of the evaluation report. Note that the appropriate evalu- ; 
ation question number is included after eacl| item for easy/ reference." Caution: 
Readers will recall that the sampling strata included 14 exceptionalities, seven 
student settings and two educational leveTs! In a research setting, table shells 
would report data for all of these sampling strata! The burden associated with 
such precise levels of, data reporting quickly becomes Overwhelming. For this 
reason, table shells have been developed which ^collapse the data into categories 
presented in Figure 3. 



LEA Tout . • , 
Exceptionalities 

Specific teaming Disabled (LD) . 

Behavioral ly/Emotionally Handicapped (EH) 

EducablB Mentally Handicapped j(EM) 

Trainable Mentally Handicapped (TM) ^ . ' 

Speech/Language Impair^ed (SI) 

* 

Other (Atjiistic, Deaf-Blind, Hearing Impaired. Multi handicapped, 

OtTier Health Impaired, Physical ly/Orthopedically Handicapped, 
Pregnant. Severely/ Profoundly Mentally Handicapped, Visually 
Impaired) 

. Student Settings ' 
Regular Indirect (REG IND) 
Regular Direct (REG DIR) . * 

Resource Room' (RES RM) * 
Block Resource (BLK RES) , 

Self Contained (SC) . . * 

Special Day- School (SDS) 

Home/Hospital (H/H) ^ . 

• It 

|flucation Level 

Elementary, grades K-8 (ELEM) . ^ 

Secondary, grades 9-12 (SEC) ' . 

Figures. Categories used in Table Shells. 



The reduction In the burden for reporting of data has been accompl Ished 
through tt,e collapsing of all low incidence exc4)t1onal1ttes into an "other- 
category and by not separSti^g the two educational levels for each exceptionality 
and student setting. Should a significant paUern of responses emerge in the 

evaluators my choose to break out the data further for specific exception- 
alfties, student settings and educational levels! The evaluation process also 
niight indicate that problems exist in a Particular .exceptionality area, student 
setting >d/or Iducational level. If this is the case, a follow-up of the 
initial evaluation may be done by selecting mre students to represent a parti- 
cular cell in Table Shell *3. Chapter VI. The actual, number to be Included can 
be quite arbitrary, but should be based'on the Judged importance of the follow-up 
personnel available to conduct the evaluation. ■ . 
Generating the Evaluation Report 

Once the table shells have been completed, the ^valuator is ready to develop 
the managemen. plan which will include the implementation plan. In generating the 
n«nagement plan, be sure to keep in mind the audience to whom the report is 
addressed. Su™,ries of particular program strengths and weaknesses will be 
useful in transmitting the evaluation information. Chapter IX will diicuss 
further the management plan for usinp the evaluation findings for program 
improvements. 
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CHAPTER IX 

■ ■ ■ ■ . * 

DEVELOPING A MANAGEMENT 'PLAN 

The value ofa Program Quality Evaluation rests in the validity and useful- 
ness of its recommendations. This chapter will present some guidelines for 
generating areas of recommendation based on the information gathered during the 
project. 

One product of-prograftn evaluation consists of the remediation of deficit 

/ 

areas, while a second involves the improvement af activities determined to be of 
primary importance. Even in LEAs where the f'indings^are overwhelmingly positive, 
there probably are areas of concern where improvement J would be desirable. These" 
activities require an identification of deficiencies as well as a determination 
of program priorities. Since student achievement is tfie desired outcome of 
special education programming, evaluation results are roost helpful when they are 
interpreted in relation to their impact on this goal. 

In order to identify areas of program need, it becomes necessary to consider 
erfch evaluation question and the data collected to assess it! Management Plan 
Worl|sheets have been provided on pages 48-56 to organize this information. The 
following steps will describe this process. . , 

1. The criteria selected for the successful attainment of each objective 
should be entered in the space provided in the management plan work- 

Sn66 t • 

Note: If a longitudinal criteria approach has been selected,' enter 
6 the actual attainment levels. 

2. The aggregated results foff each evaluation question should be entered 
in the space provided on the worksheet. 

3. Circle the number of the evaluation question where the criterion level 
has not been met. 

i ■ ' - 

4. For these evaluation questions (circled 'In step 3) examine the last 
two columns of the worksheet to determine the discrepancies between 
desired and attained levels. % 

• • • "\ ' 

5. Rank order the areas, of greatest discrepancy in\he LEA. 
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The determination of priorities, however/must also include an analysis*. 
of subjective concerns; Discussion among administrators; teachers, parent^ and 
reUted services personnel is suggested to isolate areas> concern specim to 
each lEA. The areas selected for attertl^n will not always be those with the 

y 

greatest discrepancy between desired -and attained levels. 

At this point, the development of. a Management PUn to implement program 
improvement activities is suggested, A format to organize such a plan is pro- " 
vided on page 40. 



\ 
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MANAGEMENT PLAN FORMAT i 

f\ ' . ■ ' *. : 

The Management Plan that Hs to be subfffftCd is to be made up^of six major 
components. A bre^iiidown 'of these components follows: 

,1. Cover Sheet (MP-1) - The cover sheet lists the name of the school 
syslwn, the names of the people involved, and the date that the 
Management Plan is being submitted. 

2. Introductory Information {nP-^Z) - This page includes information on 
the purpose of ^'QE, an overview of procedures;, and the purpose of 

the Management Plan. To standardize informatipn, we have written this 
page for you. , 

3. Implementation Plan (MP-3) - This, page includes the goals and objectives 
and other Information that will result from the information gathered 
through the record review and survey process. „ . 

4; Evaluation Procedures (MP-4, MP''4a, and MP-4b) - This section will. V 
Include a suirma ry of . procedures to be followed in conducting PQE. 
If there is not sufficient space on thie forms, please continue the • 
narrative on a separate sh^et. Table A should show the final sample 
plan that was developed by your school system and this shoujd be shown 
id in Table I. Table II sf!?lMld show the percentage of return for each 
of the surveys sent out. > 

5. Summary of Findings (MP-5) - 'This will include both narrative and ■ 
'statistical information. The narrative should highlight the signi- 
ficant findings for the record reviews and each of the survey instrur 
ments. Please note that you will definitely need to put this information 
oh, a separate sheet as there is riot sufficient space on the MP-5 form 
for, all of the relevant information, to be lifted. 

ThU section should also'include a statistical summary by instrument. 
Copie^of each of the instruments are included with this packej;. 

This s^tion should also include a summary by goal areas using the 
Management Plan Worksheets that are on pagel 48-56. 

^- ' Appendix ^ The Appendix should include three items: A) goals, objectives, 
and evaluation questions which can be pulled from pages 12-15; B) timet^bl 
of activities completed; and C) a list of members of the local PQE 
Advisory Conmittee. 
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INTRODUCTORY INFO RMATION 

'«r , ■ . . ... , • ■ • .• ■ 

Purpose of Program Quality Evaluation ; 

* ■ • ■ ' 

' The Special Education Program Quality Evaluation monde) was developed to com- 
plement the compliance monitoring procedures already in u?e in Tocal education r 
agencies ih North Carolina. By using a goal -based approach, the Program Quality 
Evaluation (PQE) model measures the quality of the local special education program. 
The leve]. of quality is determined by measuring student progress toward the follow- 
ing three special education goals, 

1. Determining Learner Gains/ Outcomes - Students w411 make satis- 
, ' factory progress In the specific curriculum areas in which they 
are enrolled and will develop a positive self-image for learning 
and working. 

2* Locating and Eva l uating Learners - Students between the ages of 
five through 18 who may be in need of soecial education programming 
will be located and evaluated. . - 

* ■ 

3. Placing Learnejrs Appropriately - Students will be placecl i.n an 
appropriate program consistent with their assessed educational 
needs and witn consideration for placement inrthe least yestric- ^ 
tive environment. 

■ ^^fi 

Overview of Program Quality Evaluation Procedures 

The Program Quaftty Evaluation process utilizes two major activities for 
generating data for development of the management plan. These activities are tl'ie 
following: 

a) student record, reviews, and 

.... I . . 

b) survey forms. 

A random sample of exceptional student records is selected for review by 
various LEA personnel , such as principals, school psychologists, special education 
teachers, and central office staff .^hirty evaluation areas are used to rate 
the quality of student record infornwcion. 

Survey forms that contain questions about the quality of student programming 
and Instruction are distributed to the following groups: parents, special education 
teachers, regular education teachers, related services staff, administrators, and 
exceptional students. 

• * • 

Purpose^ of the Management Plan , ' 

The data obtained from the student record reviews and the various survey forms 
are analyzed. Discrepancies between these results and the criterion level established 
by the LEA determine the areas ;f or remediation and staff development activities. 
These activities form tne bas1s\f6r the Implementation of the management plan. The 
entire management plan consists of the following sections: cover sheet, introductory 
information, implementation plan, ev«p1aation procedures, summary of findings,- and ' 
appendix. ' 
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IMPLEMENTATION PLAN 



Goal: 



Program Objective 



u» 




Area(s) Needing 
Improvement 



Action to be Taken 



4f 

Timelines 



Person (s) 
Responsible 



Target Criterion Level (s) for Next Prograrti./Evaluat1on: 




Budget and 
Facility Needs 



■ * 



J ■ 
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. ^- EVALUATION PROCEDURES 

lirulluj''"'''^'^"''^ ' ^ " ^"^"^^^"^ P^^^^'" Q'^a^itv Evaluation 



/ 



Final Sampling Plan fTahlP T) 

— ^— : ^ »^ ^ ^ . , 



Lls^t ofXins truments and Rate of Return (Table II) 



TABLE I 



FINAL SAMPLING PLAN 
Student Settings 



EXCEPT. LEVEL 



REG. 
INDIR. 



REG. 
DIRECT 



RE- 
SOURCE 



BLOCK 
RESOUR. 



SELF- 
CONTND. 



BP. DAY 
SCHOOL 



HOME 
HOSP. 



TOTA 



AU 



E 
S 



DB 



E 

S * 



^ 



EH 



EM 



HI 



E 
S 



E 
S 



E 
S 



LD 



E 
S 



MU 



OH 



E 

S. 



E 
S 



. PC 



E 
S 



PH 



E 

^ S 



SI 



E 
S 



SP 



E 
S 



TM 



E 
S 



VI 



S % 



TOTAL 





Instrument 
Parent Survey 

Special Education Teacher Survey 
Regular Education Teacher Survey 
Related Services Staff Survey 
Administrator Survey 
Student Survey I ^ 



TabTe II * 
LIST OF INSTRUMENTS AND RATE OF RETURN 



Rate of Return 



% 



% 



% 



MP-4b 
DEC 11/84 



r 



SUMMARY OF FINDINGS 



4 



Summary Of Findings by Instr ument 
Student Record Review 

Parent 



■ 1 



Special Education Teacher Survey 
Regular Education Teacher Survey 
Related Services Staff Survey 
Administrator Survey 
Student Survey 

Statistical Summary by Instrument 



4^ 



In^rtirtient A: Student Record Review 

Instrument B: Parent Survey 

Instrument C: Special Education Teacher Survey 

■ ■ / ■ . ■ • 

' Instrument D: Regular .Education Teachar 



Instrument E: Related Services Staff Survey 
Instrument F: Administrator Survey 
Instrumeixt G: Student Survey 
Management Plan Worksheets 
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^MANAGEMENT PLAN WORKSHEET 



6o«l 1: Students will make satisfactory progress In the specific curriculum 

areas In which they are enrolled and develop a positive self-lmaqe for"*^* 
learning and work. 

1.1 Students successfully demonstrate competencies In appropriate curriculum 

area$ at levels comnensurate with ability and handlcaoplng condition. 

1.1.1. Are reading competencies attained commensurate with students' abilities 
and handicapping conditions? 



Evaluation 
Question 


Inst/ ' 
Item 


Critn 
Level . 


Evaluation * 
Results 1, ' 


1.1.1 


A22 

Bl . 
CI 

Dl , 




O 4 

• 


- ■ — 1 — - ■ ■ • . t 

Afe language arts competencies attained 'comnensurate with students' abilities 
and handicapping conditions? 


i:i.2 


A23 

B2 

C2 

41 







1.1.3 Are* math competencies attained commensurate with students* abilities and 
handicapping conditions? 



SERJC 



1.1.3. 

• 


A24 

B3 

C3 

^ D3 




; ' 

■ i 


4 

1.1.4 Are vocational competencies attained commensurate with students' abilities 
and handicapping conditions? 


1.1.4 


A28 
B8 

' C7 
D7 

g-v 




1 

t 

* 


rrl.5 Are science competencies aittained comnensurate with student^s abilities and 
handicapping conditions? 


1.1.5 A. 

.' k • . ' 


A2^ 
B4 
. C4 
D4 

4 

''1 ' 


0 


7\ ... 

.fifi — ^ ■■- - - 1 , - 
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^'^'^ Ar^ fOcUl Studies competencies attained commensurate with students 
aDintles and handicapping conditlftns? 



Hi i 

1.1,6 ' * 


A26 

.B5 
C5 
05 






1.1. V Are cul 
abil1ti( 


tural arts competencies attained cownen sura te with studerUs' 
BS and handicapping conditions? , fT 


1.1.7 

1 


A27 
B6 
C6 
06 


■ — 1 1 





^•^'^ ?Mi^?'?r*^"S^f i?'' 'healthful living attained conwensurate with students' 
abilitijBs and handicapping conditions? 
. Self-Help Skills/Life Skills . ' 

• Physical Education/Health Education . 



1.1,8 



A29 


VJ 




A30 




87 


<> 




C8 






C9 






08 






09 


1 





V-2 Positive work habits are developed in the course of the students' education 
^'^ ^sitlSl ^rk^habitsr^^^" ""^^''"^^ ^° development of students' 



1.2.1 



y 




B9 




CIO 




010 




G4 




G7. 




1 4 





/^■^ ^f^e^^lvel v contributes to the development- 

of students' positive attitude toward self ^nd others. 



1.3.1 Does the Special education program contribute to the development of positive 
attitudes toward self? - ^ 




i.3.2 Does the spec tdl education program contribute to the development of / 
positive attitudes towards others?. 



1.3.2 


Bll 


• 






CI 2 








D12 








E2 






• 


G3 . 








G8 
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J\A The special education program effectively contributes to the students' 
desire to learn. 

1 ■ ' . 

1.4.1 Oo^s the special education program contribute to students' desire to learn? 



1.4.1 



B12 




CIS 




D13 




E3 




G6 




G9 





Goal 2: Students between the ages of 5 through 18 who may be in need of special 
education programmin'gSitll be located andt^evaluated. 

2.1 The referral and screening efforts that lead to evaluation of children who 
may need special education are thorough and systematic . 

2.1.1 Do parents and professionals make responsible referrals that identify those 
^tu dents who should be suspected of needing special education? 



2.1.1 


CI 6 


1 1 „ 

V 






E5 • 




* 




Fl 




» 



2.1.2 Are children who may be in need of specia*! education referred for individual 
screening as early as should be expected? 



2.1.2 










CI 7 






— 


E6 


— 





'2.1.3 Are the mass screenings or sweep screenings effective-in identifying those 
students who should receive further screening or evaluation? 





b ■ 




, T — 


,2.1.3 


CI 8 








D16 








E7 




, .1 — , , ' _ 
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2.1.4 Do the pre-referral Initial conferences provide effective alternatives to 
special education which allow students to succeed in regular education? 



2,1 .'4 


cia 

D17 
E8 


• • 

. . t 


— — _ . f 

■■— ' ,'. — 

■ 


2.1.5 Do the observations prior to referrals contribute to decision making In 
^ the evaluation process? ^ 


2.1.5 - 


Die 

E9 

% 




— ■ 3^ 


• .. 

2.1.6 Do the referrals accurately reflect' the needs identified by the screening 
data and Information from persons referring the student? 


2.1.6 


Al 
C20 
ElO 
F3 







needs identified 



2.2" Evaluations and re-evaluations adequately address possible 
itnthe referral. I 

2.2.^1 Do the evaluations/re-evaluations address each of the possible needs 
identified in the referral and/or other relevant data? 



2.2..1 


\ 

A2 






K ■ 


C21 






1 


Ell 




1 



2.3' Techniques used in conducting screening, evaluations and re-evaluations are 
appropriate . 

2.3.1 Do the referrals provide useful Information that assists in the selection 
of evaluation, instruments and techniques? 



2.3.1 . 1 


1 


A3 

- E12 






2.3.2 Are all needs identified in referrals addressed by^aluation techniques? 


2.3.2 

• 


A2 
E13 




4 



2.3,3 I)p th6 techniques used In conducting eva1u«t1ons/re-evd1uat1ons take 
Into Account such student considerations as age, disability and native 
language? . * 



2.3.3 


A4 




^ 




C22 ' 








El 4 







'0 



i 



2.4 Evaluations and re-evaluations provide clear, relevant educational Infor- 
^ matiojff sufficient for determliring eligibility. 

2.4.1, Do the evaluations and re-evaluations provide clear, relevant /.education 

information sufficient for determining eligibility of studeritsvfor special 
education? - • 



2.4.1 


El 5 








F4 







2.4.2 Do the evaluations and re-evaluations provide clear, relevant information 
which assists in enabling the school-based Committee/administrative place- 
ment committee to make placement decisions? 









■ . _ ; , f ^ 


2.j4.2 


E16 






F5 


\ 











2.4.3 Do the evaluations and re-evaluations provide clear, relevant information 
which assists in enabling the .school -based committee/administrative place- 
ment committee to make decisions regarding necessary instructional 4lcv1ce$? 



2.4.3 


D19 
E17 
F6 




\ 


2.4.4 


Do the evaluations and re-evaluations provide clear, relevant Information 
which assists, in enabling .the „school -based committee/administrative place 
ment committee to, make decisions regarding related services? 


2.4.> 


E18 
F7 







2.5 The reappraisal of the effectiveness of educational programming ^nd place- 
ment at the annual review is constructive. 



2.5.1 



Do t 
data 



Mmi 



nUal reviews thoroughly examine such information *as evaluation 
Ivi dualized Education Programs, and teacher reports? 





* 




2.5.1 


AS 






B14 






E19 




M.. r • r. 
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2.5.2 Do the annual reviews thoroughly examine students' .continuing el iqiblH 
far special education? 



"2,S.2 


A6 

B15 

E20 




■—-^ J* , , 


2.5.3 Do the annual reviews thoroughly examine the need for changes in students 
Instructional services? J *" ' 


2.5.3 


A7 

B16 

E21 




W ifc 

t.. 

A — . , 

I 


2.5.4 Do the annual reviews thoroughly examine the continued appropriateness of 
students' related services? / • " 


^.5.4 


k A8 

B17 
E22 






2.5.5 Do the annual reviews thoroughly examine the continued appropriateness o# 
students'^ placements? 


2.5.5 


A? 

Bl8 

E23 







Goal 3: Students will be placed in an appropriate program consistent with their 
assessed educational needs and with consideration for placement in the 
least restrictive environment. 



3.1 Individualized Education Programs are comprised o*F elements appropriate 
to the assessed needs and levels of performance of learners."^ 

3.1.1 Are the Individualized Education Program statements of present level of 
performance derived from actual assessment data? 



3.1.1 


AlO 








„_JC23 






1 - ^"f 


E24' 







3.1.2 Are the Individualized Education Procjram annual goals and short*term 
j^bjectives based on Identified needs? 



3 

All 




C24 




020 




E25 




.:; , .,,1 , , 





3.1.3 Are the evaluation criteria In Individualized Education Program objectives 
clear and usable? - ... 




i 



3.1.4 Are the appropriate types of regular education provided, considering 
assessment data? 



3.1.4 




3J .5 Are*the appropriate types of special education provided, considering assess- 
ment data? » 



3.1.5 




3.1.6 A?e the appropriate types of related services provided, considering assess- 
ment data? c - . " 




3.1.7 Are the appropriate types of vocational education services provided, con- 
sidering assessment data? - , 




3.1.8 >Are the appropriate amounts of Tegular education provided, considering 
assessment data? 
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3.1.9 Arft^the appropriate amounts of special educaJtlon provided, conslderlnd" 
assessment data? , p my 



3.1.9 


Al8 
C31 
027 
E32 




$ 


3.1.10 Are the appropriate amounts of related services provided, cons Iderlna 
assessment data? ' ' ^ 


3.1.10 


A19 
*C32 
028 
E33 






3.1.11 Are the appropriate amounts of vocational education service/ provided 
considering assessment data? 

« ■ 


3.1.11 


A20 
C33 
029 
E34 






3.2 The Inclusion of special needs- students In regular programs enhances their 
social development. / 

3.2.1 Do students Included tn regular education programs benefit socially? 


3.2.1 

* 


B19 

CI 4 

014 

E4 

Gl 

GIO 






■ ' ■ ' ^ 

3.3 The Inclusion of special needs students In regular programs enhances their 
educational deveJopment. ^ 

3.3.1 Do students Included in regular education programs benefit academically? 


3.3.1 

m 

•> * 

• 


B20 
015 > 
015 


/ 


* 



3.4 Parents are active participants in decision making regarding the place- 
ment and educational planning for their children. 
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3.4.1 Are the communications from the school to the parents conducive to 
building positive relationships? \ 



3.4. V \ 


A21 
B21 
F12 






' p— ^ — : ■ . % 


3.4.2 


822 
C34 ,. 
D30 
E35/ 
' Fll 




m 


3.4.3 Are parents Isked to provide information regarding the placement and 
educational planning for their child? , 


3.4.3 


B23 
D31 
F14 




" ■ — p ~ 


3.4.4 Is all information supplied by parents considered in decision making? 


3.4.4 

— \ — . — _ 


B24 
C35 ' 
F15 
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SAMPLING PLAN T/^BLE SHELLS 
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TABL^ SHELL #1 
STUDENT SETTINGS 



EXCEPT. 


JNDIR. 


RES. 
DIRECT 


RE- 
SOURCE 


BLOCK 
RESOUR. 


SELF ■ ' 
CONTND. 


SCHOOL 


nyrlt 

HOSPr> 


^ TOTAL . 


All 
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PH 
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SP ' 
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TM 




















VI' 




















TOTAL 














1 
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TABLE SHELL #2 
STUDENT SETTINGS 




f 



59 



67 



TABLE SHELL #3. 
FINAL SA»ltP|.ING PLAN 
STUDENT SETTINGS 



EXCEPT. 


LEVEL 


■ RC6. 
INDIR'. 




■ m. 

DIRECT 


1 11^ ■■" 

SOURCE 


' BLOCK ~ 
RESOUR. 


SELF ~ 
CONTND. 


or. UM 

SCHOOL 


to 

nunt 
HOSP. 


TOTAL 


AU 


E 
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DB 
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S 
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S 
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PH 
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TOTAL 
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APphoiJi B ; 

INSTRUMENT/\riON 
/ * 

^. Student Record Review 

B. Parent Survey 

C. Special Education Jeacher .Survey 

D. Regular Education Teacher Survey 

E. Related Services Staff Survey 

F. Administrator Survey 

G. Student Survey 

H. Optional Self Study 




9' 



INSTRUMENT A • . , 

^ , . STUDENT RECORD REVIEW 

Instructions to the Records Reviewer 

- ~- ■ < ^ ^ _ ^ 

Once student records have been selected for review^ it Is Important to 
remember that all information may not be^contained In each record hut may 
exist in other files. Omit questions which require unavailable data, if it. 
Is not possible to locate pertinent information. 

If an original student referral is more than five years oldTall questions 
which require an analysis o^ the referral should be omitted. This is done 
^because of changes In student need, program design and/or legislative mandate 
which may have occurred. • iffe ► - 

Review each record ajid locate the following Information source documents: 

1. Referral Form - The mqst recent referral for special education services. 

2. Screening Results - The results or report of any Individual and/or sweep ' 

^ . screening. 

3. SBC Report - The report or minutes that have resulted from the most recent 

schoolVbased committee meeting.. - 

■ Oj jfgJuatlon Report - The results of the most recent battery of .student ' 

assessments. 

5. Re-evaluation Report -'The results of the most recent battery of student 

' ' re-assessments. 

6. APC Report - The report or minutes that have resulted from the most recent 

administrative placement coirmittee meeting. » ' 

.7. I.E. P. « The Individualized Education Program currently In effect . 



Teachers!^lated Services Reports - «Any reports or written statements 
■^^F^ relating to student strengths, weak- 

nesses and/or progress (Include informal 
assessments), by regular or special 
education teachers or by related 

* . _ service personnel. 



9. Annual Review - The minutes or report from the most recent annual review. 

10, Report Cards/School Transcripts - Formal reports ^f a student's Jchool 

performance. / / 
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Parent Contacts - Records of school -Initiated. parental contact, Including 

phone call 8^ copies of letters, etc. 



Standardized ^^estf Results - Standardized test results for the last three 

I ' ' years In the following acWeoilc areas: reading, 

language, mathematics, vocational areas, science 
social studies, cultural arts and healthful 
living. 



Competency Test Results - The results of comoetency testing in reading and 

I mathematics. ~ , • 



\ 



» 
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Instrument ^ 



STUDENT RECORD REVIEW 



Reviewer's Initials: 



Date: 



•Using the information, that you have identified from individual 
student records, score each of the evaluation areas by rating 
the extent to which the evidence suppojjjj);s each statement: 



♦RATING 5CALE 
(Circle the 
^ Appropriate 
Rating) 



E 
S 
U 
NA 



Excellent 
Satisfactory 
Unsatisfactory 
Not Applicable 



Evaluation Area! 



Student's Name: 
Exceptional ity: 



Grade: (check one) 

Elementary (K-8 
Secondary (9-12 



Present, Placement: 



Evaluation: * (check one) 
" Initial 

Re-evali^tion 



Native Language: 



Directions 



Al; The referral accurately reflects ' Al, 
the needs identtfied by the screening 
data and information from the persons 
referring ^he students. (2. 1 .6) 

A2. The evaluatioh/re-evaTuation addresses A2, 
the needs identified in th6 referral 
and/or other relevant data. (2.2.1) 
(2.3,2) 



A3. The referral provides useful infor- A3. 
^ ' mation that assists In the selection 
of evaluatiQn Instruments and techniques. 
. (2.3.1) ^ 



^f^a tings 



A4. 



' The techniques used .in con<|ucting 
evaluation/re-evaluation ti^ike into 
account such student considerations 

4 3$ age, disabllitij^, and native 
language. (2.:r.3) 

1 * . 



A4. 



Examine the ne»ds listed in screen- 
ing results and SBC report. Compare 
to those listed in referral form/ 
Rate the comparison. 

Examine the needs listed in J^eferral 
form. Compare these to the listing 
of needs in evaluation report, teacher 
report, annual review, and lEP state- 
ment of need. 

Compare information gathered in re- 
ferral form and evaluation report to, 
determine if referral information is 
used In the planning of evaluation* 

Examine the informatlorr collected 
in e\*aluat1on/re-evaluation report. 
Compare this to descriptive datar 
recort(fed In the box at th6 top of 
this Instrument, ^ ' 




Evaluation Area 

/)■■ 

A5, There is concrete evidence that the 
annual review t)as thoroughly examined 
suc/i information as evaluation data, 
•the Individualized Education Program 
and other relevant data ,to determine 
the appropriateness of continued 
placement and/or related services. (2. 5. 

A6. There is concrete' evidence that the 
annual review has thoroughly examined 
the students' continuing eligibility 
for special education. (2.5:2) 

A7. There is concrete evidence that the 
annual review has thoroi^ghly examined 
the need for changes in students' 
instructional services: (2.5.3) 

A8. There is concrete evidence thai the 
annual review has thoroughly examined 
the need for changes in students' 
related services. (2.5.4) 

A9. There is concrete evidence that the 
annual revie<^ has thoroughly examined 

. * the continued appropriateness of 
student placement. ^(2.5. 5) <* 

AlO. Ther Individualized Education Program • 
statements of present lev.el of "per- 
foniiance are derived fron^actual . 
formal andlinformal assessment data. 
(3. .1) ^ \ 



7 k 



All. The Individualized Education Prograr 
goals and short-term objectives are 
'ba^sed on identified needs. (3.1,2) 



Directions 

m 

A5. Examine the reports of annual reviews. 
Determine how thoroughly the inforl 
mation in evaluation and re-evalu- 
ation reports. APC report, teacher 
report, and the lEP was examined in 
the annual review. 

1) 

A6. ^xamine the report; of annual review. 



AT'.' Examine the report of annual reviews. 



A8. Examine the report ^of annual r.eviews/* 



A9. Examine the report o^arinu'ai•'re\/iews^ 



■ If -I ^ . 



I ■ ■■ " , •■1. ,. < 



AlO. Examine the lEP - present levels of 
performapce. • Compare' tp teachers, re- 
ports and standardized *;test' resiilts* 
(If test resujti '^1^6 insufficient. V 
refer to screen i ng , re&ul ts > . | 
eval Uatipni%d; .re^^^vlt uatlo^ i^epdrts . ) 

Alli Examjne;:jthe lEP goals and objectives. 
Corpp^re- them'lib SBC report, referral 
^ form, evd,luatJon and re-evaluation 
reports '(If i'bprdpriat^) 4 ARC report » 
r and teatJiie*'; re|)orts. , ' . 



Evaluation Area 



Directions 



A12» Evaluation criteria in Individualized 
• Education Programs are dear and 
usable, (3«lJ) 

A13. The appropriate type! of regular 
education are provided, considering 
assessment (data. (3.1.4) • ..i 

. \ ' ■• • . 

A14, The appropriate types- of special 

education are provided, considering 
, . assessment data. (3.1.5) 

A15. The appropriate types of related 
services are provided, considering 
assessment data. (3.1.6) 

A16. The appropriate types of vocational 
education service^ (are provided, 
considering assessjuent data. (3.1.7) 

A17. The appropriate amounts of regular 
education are provided, considering 
as$es^nt data., (3.1 .8) 

A18. The appropriate amounts of special ^ 
education are provided,, considering 
assessment data. (3.1.9) 

A19. The -appropriate amounts pf related 
services are provided, considering 
assessment data. (S.1.10) 
I ■ ' 

A20. The apji^ropplate amounts of vocational 
education services are provided, 
considering assessment data"' (3.1.11) 

,A21. The documented. evidence from the 
school td parents indicates that 
the contact .Is eonducife to buildirig 
/ positive relatlonshlpj. (3.4.1) 



A12. Examine the lEP - objectives. 



A13. Examine the lEP - regular education 
placement. Compare to standardized 
test data. / 

Al 4. Examine the lEP - special education 
placement. Compare to standardized ' 
test data. 

A15. Examine the lEP - related services. 
Compare to standardized test data. 

A16. Examine the lEP - vocational services 
Compare to standardize^ test data. 



Al 7. Examine the lEP - regular education 
placement. Compare to standardized 
test data. 

A18. Examine the lEP - special education 
placement^ Compare to standardized 
test data.' 

i ■ ■ • ■ 

A19. "Examine the lEP - related services. 
Compare to Stai^ardtzed test data. 



A20. Examinfl^ the'IEP - vocational services 
. Comparelto standardized test data. 



A21. Review evidence of parent contact 
such as notes » phone calls, con- 
i ferences, etc. 



^2"v?l2S'Kjott^^^^ -pleted ne.s A,-A2, above and .avin, 

L Evaluation Area 



A22. Reading competencies are attained 



/ - *Ratinqs 



' comnensurate with students' abilities E S U NA' 

and handicapping conditions. (Kl.l). • 



'E S ' U NA I 



U NA% 



'7b 



U NA 



U NA 



A23. Language arts* competencies are attained 
conmensurate with students' abilities 
and handicapping conditions. (1.1.2) 

A24. Math competencies are. attained commensurate 

with students' abilities and handicapping 
conditions. (1.1.3) / . 

A25. Science competencies are attained com- 
mensurate with students' abilities and 
handicapping condition^. (1.1.5) 

A26. Social studies' competeacies are attained 
commensurate with students' ab1|,1t1es 
and handicapping conditions. (1.1.6) 

A27. Competencies in the cultural arts are - ^ r s ii na 

attained commensurate with. students' ' 
abilities and handicapping conditions. (1.1.7) - ' - , — „ - - . 

A28. Vocational Education competencies are F <; n na 

attained comnensurate with students' . X t . o , u nm 

abilities and handicapping conditions. (Kl .4) \ ^ * • ' 

A29. Competencies in self-help/life skills " * , E S ii^ na 

are attained corrniensurate with students' \ ^ ^ u 

I abilities and handicapping cond1t1ons.| (1.1 .8) ^ . ~ 

A30. Competencies in physical edu6«hl;1 on/ 

health education are attained commensurate I > 
with students' abilities and handlcappiiiq 
conditions. (1.1.8) rr ^ 



U NA 

s 



7?) 



Instrument B 
Parent Survey 



^ ■■■■■■ji 



Instruction s to Parents : We would like to know how you feel about your 
child's special education program. Your answers will help us make sure 
— - 1sjgfiU445ig a good total school program.* 

» 

' Please put an 'X' in the space to the right of each statement that 
tells how you feel about your child's special education program. It is 
Important that you respond to each statement. 

Your answers will .be used only for program evaluation purposes. Return 
the completed survey in the enclosed en\j,lope to 
by 



. Thank you for yo# assistance. 



U 



♦Example: The special education program 
is effective in developing my 
child's skills in language arts 
(writing, reading, grammar, 
spelling, punctuation). || 



NA 



Instructions to Evaluation Coordinator : Select the parents of 'f;tijHenf^ 
receiving special education services using random sampling procedures. 
Code the student I s name on upper right corner of next page. Please ; 
follow through to ensure that parents return fully completed forms. 



\ 



i 



B. Parent Survey 



i 



0) 

u 

X 



The special education program is effective in developlnq 
n\y child's skills In the following areas: 

1. Reading (1.1.1) , ' 

2. Mnguage Arts (1.1.2) ~ 

a. liath (1.1.3). - 

,4. Science (1.1.5) 

5. Sbcial Studies (1.1.6) — ~ 

6. C^jlturjil Arts (1.1.7) 

7. Healthful Llvina(e.g., physical education, 

health education, life skills and self-help 

, sl^ills) (1.1,8) 

8. Vocational Education (1.1.4) ' 

<»9. The special education program helps my child 
develop good work| habits. (1.2.1) 

10. The special education program helps my child 
feel good about himself /herself. (1.3.1) 

11. The special education program helps »riy child 
feel good about other people. (1.3.2; ' 

12. The special education prjgram encourages my ^ 
^ ' child to want to ■learf). Tl.4.1) 

13. child was referred and tested as soon as 
a problem was suspected. (2.1.2) 

14. The yearly Individualized Education Program 
and annual review meetings consider Informa- 
tion such as test Information, the Individ- 
ualized Education Program and teacher . 
reports. (2.5.1.) 

■ . ^ ■ ~ ' . 

15. The yearly Individualized Education Program 
_ meeting considers whether or not my child 

should continue in special education. (2.5.2) 

16. The yearly Individualized Education Program 
meetings consider the need for chandes In my 
child's classroom Instruction. t2.s.3) I 
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20. The regular school programs help iny child's 
school work. (3.3.T) 

21". The conferences, phone calls and letters 
from the schooV help the schoal ,and me 
work together. (3.4.1) 

22. The school keepsL me Informed about my 
child's progress. (3.4.2) 

23. The. school asks me for information about 
planning my child's school program. (3.4.3) 

24. The school uses the information that I give 
them to plan my child's program. (3.4.4) 



X) 

41 fd \A CL 



5- 



0) * T- . flO 

X (O c o 

i/> 3 Z 



17. The yearly Individualized Education Program y 
meetings consider the need for changes ijrj n\y 
child's related services (e.g., speech 
therapy, counseling, physical therapy). (2.5.4) 

18. The yearly Individualized Education Program 
meetings consider whether my child is getting 
the right special help. (2.5.5) . 

19. The negtrlar school programs help mv child in 
the way he/she. behaves and gets along with 
others. (3.2.1) 





V 




■i' ■ \ ■ 

Special Education Teacher Survey ^ 



Bate 



. .Instructions to Teichtrs: The staterents in this survey reflect vallous 
aspects Of the school program received by special needs students. Please \ 
assist in the overall program evaluation by placing an "X" in the appropriatl;' 
space to indicate the extent that each statement descrii^Ps your school oroor 

. for special needs students . Do not include gjfted and talented students. Your 
responses will be used only for prograr, evaluation purposes. Return the con- 

. pleted form to , ; 5y 

Thank,you. for your assistance. " 

Teacher's Name ^ . ^' , 

Level Taught: (check oneK Elementary («rad6s K-8) - 
;• ' VSecondary (Grades 9-1?) T 



Student. Settings: (check one) Regular Indirect 

Regular iDlrect 
*'; Resource Room 

Self Contained 
Special Day School 
' » ^ Home/Hospital 



adon survey to special education teachers (do not include teache^^ of^rlHlr 
Ically gifted) randomly selected to represent v6ur LEA WthL^ h J^^^""' 
[ensure !hat afl selec ted teachers resZd1o"\{?'of'-^g; c.'i^^I^ VSe^yLl^". - 



Ci SPECIAL EDUCATION TEACHER SURVEY 



CI. 



C 



4i 
u 

X 



CO 



o 



CX 
< 



C3. 



C4. 



Reading competencies are attairted com- 
mensurate with students' abilities and 
handicapping conditions. (1.1.1) 

C2. Language arts competencies are attained 
. commensurate with studeQts' abilities 
and handicapping conditions. (1.1.2) 

Math competencies are attained commensurate 

ctd^?^ot"%.f^/'^■^^^"^'^^"^^-p^^"9 - 

Science competencies *are attained com- 
mensurate with students' abilities and 
hdndicappfng conditions. (1.1.5) 

C5. Social studies competencies are attained 
commensurate with students' abilities 
and handicapping condition?. (1.1.6) 

« 

Cultural arts competencies are attained 
commensurate "With students' abilities 
and handicapping condUions. (l.l'.y) 
• ' • 

Vocational educatidn competencies are 
attained commensurate with students' ~ 
abilities and handicai)pinq conditions. (1.1.4), 

Self-t>elp skills/life skill's competencies 
arre attained commensurate with students' ~ 
abilities and handicapping conditions. (1.1.8) 

Phys 1 ca 1 educat 1 on/hea 1 th educa 1 1 on 
competencies ^re attained commensurate ~ 
with students' abilities and handicapping 
conditions. (1.1.8) \ ^ 

The special education program contributes 

to the development of students' positive "~ 
work 'habits. (1.2.1) . . 

The special education program contributes 
to the development .. of positive attitudes 
towards self. (1.3.1) 



C6. 



C7. 



C8. 
C9. 



CIO. 



Cll. 
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C12. The special education program contributes 
to th^ development, of positive attitudes 
'towards others. (l!3.2) 

f 

C13. The spiBclal education proqram contributes 

to students' desire .to learn. (1.4.1)^-^ Li 

C14.. Students who are Included In regular 

education benefit socially. (3.Z.1) 

CIS. Students who are Included In regular 

education programs benefit academically. (3.37T7 

C16. Parents and professionals make respo/is- 

tble referrals for those students who 
are suspected of needing special 
education. (2.1.1) \ 

CI 7. Children who may be in need of special 

education ape referred for Individual 

screening as early as should be expected. (2.1.2) 

C18. The mass screenings or sweep screenings • 

are effective In 1<Jent1fy1ng those 
students who should receive further 
screening or'evaluatlon. (2.1.3) 



C19. Jhe pre-referral Initial conferences 

provide effective alternatives to special 
education which allow students to 
y succeed In regular education.. (2. 1 .4) 
■ • * ' 

620. The referrals ac(jvrately reflect the 

needs Identified bj^ the screening data ^ 
and Information from the persons referring 
the studei^J. (2.1.6) 

C21. The evaluatlon/re-evaluatlon addresses 
the needs Identified in the^ referral * 
and/pr other relevant data*. (2.2.1) 

C22. The techniques used In conducting eval 
V^tlon/ re-evaluation take Into account 
such student considerations as age, 
) * disability, and native language. (2.3.3) 

\C23. The* Individualized Education Program 
statertients of present level of per-' 
.formance are derived from actual formal 
and Infonnal asi&essment data.(3.K1) 

• ' - ' ■■ . . ■ ■ . . * -es- 
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C24. The Individualized Education Program annual 

goals and short-term objectives *are based 
^,on Identified needs. (3.1.2) 

C2^ ' The evaluation criteria in the Individ- 
ualized Education, Program objectives 
are clear and usable. (3.1^3) 

C26. The appropriate types of rflgwlar education 
classes* are provided, considering assess-} 
ment data. (3.1.4) \ 

C27. The appropriate types of special edu- 4 

cation (e.g. classes for learning \ 

disabled, mentally handicapped) are - 

, provided, considering assessment data. CS'.l. 

C28. The appropriate- types of related services 

are provided, considering assessment 
J data. (3.1.6) 

C29. The- appropriate types of vocatiorral 
education are provided, considering 
assessment data. (3.1.7)^- 

C30. The appropriate amounts of regular 
education are provided, considering 
assessment data. (3.1.8) 

C31. The appropriate amounts of special' 
education are provided, considering 
assessment data. (3.1.9) 

C32. The appropriate amounts of related 
services are provided, considering- 
assessment data. (3.1.10) 

C33. The appropriifte amounts of vocationa-l 

education •Ser'vlces are provided, con- | 
sidering assessment- data. (3.1.11) 

C34.. The School has suffic'lent personal ' 
contact with parents regarding 
V progress of their children. (3.4.2) 

C35. Information supplied by parents is used 
in decision making. (3.4.4) 



Instrument D 



Regular Teacher Survey 

Date 



Ins^ 



uctlgns to Teachers ; The statements In this "syrvey reflect various 



aspects of the school program received by^^'s^^^^ needs- students . Please assist 
In the overall prograln evaluation by placing an "X" In the appropriate space to 
indicate the extent that each statement describes the total sjjpol program for 
special needs students . Do not Include gifted and talented students. Your * 

# 

responses will be used only; for program evaluation purpose?. Return the completed 

formHo • ' by / ^ 

Thank you for your assistance. 



Teacher's Nam6 



Grade Level Taught: (check one) . Element^iry (Grades K-8) 

Secondary (Grades 9-12) 
Suhj££t Area Taught: ' 



Instructions to Evaltiatipn Coordinator ; Plelase distribute this program Pvalu-' 
•' fttton survey to teachers randomly selected to represent yoUV LEA. This rSndom 
selection should include Vocational education teachers. Follow through to 
ensure that all selected teachers respond to all of the survey questions. 



/ 



D. 'Regular Education Teacher sli 



0)' 



0) 

o 



Dl. Reading competencies are attained com- 
mensurate with students' abilities and 
handicapping conditions. (1.1.1) 

D2. Language arts competencies are attained 
commensurate with students' abilities * 
and handicapping conditions. (1.1.2) 



\ 



D3.\Math competencies" are attained com- 
mensurate with students' abilities and 
handicapping conditions. (1.1.3;) 

D4. Science competencies are attained com- 
mensurate with students' abilities and 
handicapping conditions. (1.1. 5) 

D5. Social studies competencies are attained 
commensurate with student^' abilities and 
handicapping conditions. (1.1.6) 

D6. Cultural arts competencies are attained 
commensurate with students' abilities and 
handicapping conditions^ (1.1.7) 

D7. Vocational education competencies are _ 
attained commensurate with students' 
.•abilities and handicapping conditions. (1.1.4) 

D8. Self-help skills/life skills competenctes 
are attained commensurate ^th stutfenis:.' 
abilities and han?licappinq condi tftjip.* (1 .1 .8) 

D9. Physical education/health educatl^TK _ 
• competencies are attained conitiensurate 
with students' abilities and handicapping 
conditions. (1.1.8) 

010.. The special education progrart) contributes _ 
to the development of students' positive 
work habits. (l.|.l ) , ' 

Ol>. The special education program contributes _ 

to the development of positive attitudes 

towitrds self. (1.3.1) ^ 

. I • ' 

012." The special' educa'tlon program contributes 

. to the development of positive attitudes 
towards others. (1.3.2) 
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pi 3. Tile special 'education pwjgram contributes 
. to students' ^^sWe to learn. (1 .4.1) 

DI4. Students who ire included in -regular 

education programs benefit SQciatly. (3;2;1) 

/ ■ • . ■ 

Dl 5. Stuaenj;s' who are. included in regular 

education pl^ograms /benefit academ-' 
ically. <3.3.1) - ' •• • 

•/* 

D16. The mass screenings* or sweep screenings 

are effective in identifying those 
students who should receive further 
screening or evaluation. (■2.1,3) 

D]7. Pre-referral corfrerences provide effec- _^ 

tive alternatives to special education 
which allow students to succeed in ' 
regular education. (2.1.4) . ' 

D18. Observations prior to referrals contri- * ^ 

bute to decision making in the. evaluation 
process. . (2.1 .5)>. 

♦ 

D19. The evaluations and re-eval\iations proVide ^ 

clear, relevant information which assists 

in enabling the sfchooi-based coitlnittee/ 
administrative placement committee to make 
decisions regarding instructiojial services. (2.4. 3j 

020. The Individualized Education Program annual 

goals and s ho rt-^erm objectives are based 
on identified needs.* (3.1.2) 

•021. The evaluation criteria in Individualized * - 
Education Program objectives are clear, 
and usable. (3.1.3) ' ; 

022. The appropriate types of regular education ^ 

classes are provided, considering assess- 

♦ lament data. (3.1,4) |r 

023. 'The appropriate types of special (Education' 

(e.g., classes for learning disabled, 
mentally handicapped) are provided, 
^ considerirfg assessment data. (3.1.5) 

024. The appropriate types of delated services . 
' (e.g., speech therapy^r counseling, physical 

therapy) are provided, considering assess- ' 
irtent data. (3.1.6) v 



02^. The appropriate types of vocational educa- 

tion services are provided, considering 

•assessment data. (3.1.7) ' :r 

|D^6. The approprtate amounts of regular educa- 
tion are provided, considering assessment " 

dat^. (3.1.8) , 

D27. the appropriate amounts of special Educa- 
tion are provided, considering assessment . 

data. (3.1.9) , , ^. • ^ ; j. 

D?8. The-appropriate amounts of related services 
'are provided, considering assessment data. (3TT7TD) 

.029. The appropriate amoynts of vocational 

education services are provided, con- '~~ 
7 sidering assessmen.t data. (3.1.11) . 

W. The scliools make sufficient personal 
f' contact with parents regarding progress 
of their children: (3.4.2) 

■ -1* ■ 
031. Parents, are asked to provide information 
regarding the placement and educational 
planning for their child. (3.4.30 , 
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• Instrument E 
Related Services Staff Survey 

Date 



/ instructions to Rela^cUervices Staff j Related services staff shall 
, include psychologists, physical therapists. occupaWonal therapists, audio- 
logists. social workers, nurses, speech therapists, guidance counselors, and 
adaptive physical education specf4,11sts. The related servic|s staff members to 
participate in this survey are determined by the LEA, Persons under contract 
may be considered. Jhe statements in this survey reflect various aspects of * 
the school program received by special needs students. Please assist in'th^ 
overall program evaluation by placing an "X" in the appropriate space to ' 
indicate the extent that each statement describes the school program for 
special needs students. Do not include gifted and talented students. Your ^ 
*respo;ises will be used only for program evaluation purposes. Return the 

completed .form by ; 

Thank yoiJ" for your assistance. 

Name j • , . 

■ ♦ ' ■ 



l^osition 



Grade, Level: (check one) Elementary (grades K-8) 

Secondary (grJdes 9-12) 



to represent your LEA. Polforthro gh 
to ensure that all staff respond to all -of the Purvey questions. 
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E. Related Services^taff Survey 



4i 
C 
1) 



EK The special education program contributes 

to the development of positive attitudes ^~ 
towards self. (1.3.1) 

E2.* The special education program contributes 

to the .development of positive attitudes 
towards others. (1.3.2) 

« 

E3. The special edpLtion program contributes 

to^stjudents' cNpre to learn. (1.4.1)- ,) 

E4. Special education students included in 

regular education pr^gram^ benefit socially. (JTzTl) 

E5. Parents and professionals make appropriate f 
referrals for those students wha are sus- ^ 
pected of needing .special, education.- <2. 1 .1 ) . 

E6% Children who may be in need of special 
education are referred for jjjtMvtdual 



screening is early as should be exjicted. (e.i .2J 



Mass screening' or sweep scre^ings are 
effective in identifying those students 
who should receive further screenings or 
/ evaluations. (2.1.3) : ^ 

' E8. Pre-referral initial conferences provide 
effective alternatives^ |:o special educa- 
tion which allow studwks' to succee^l in 
- regular education. (2.1.4) 

E9. • Observations prior to referrals contribute 
to decision making in the evaluation 
process* (2.1.5) 

El 0. Referrals accurately reflect the needs, 
identified by the screening data and 
information from the persons referring 
th? stQdent. (2.1.6) 

Ell. the !9valuat1on/re-evaluat1on addresses 
'the needs Identified in the referral 
and/or other relevant data. (2.2.1) 

E12. Referrals provide us#fuMnfonnat1on that 
'assists in the selection of evaluation 
Instruments and techniques. (2.3.1) 
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El 3. All needs identified in Veferrals are 

addressed by evaluation techniques. (2.3.2) 

E14. The techniques used in conducting evalu- 
ations/re-evaluations take into account such, 
student considerations as aqe, disability, 
and-native langliage. (2.3.3; - 

E15. The evaluations and re-evaluations orovide 
clear, relevant educatioh* infoHnation 
sufficient for determining eligibility 
of students, for special education. (2.4.1) 

El 6. The ^valuations and re-evaluations provide 
clear, relevant information which assists 
In enabling the school -based committee/ 
administrative- placement committee to 
make placement decisions. ((2.4.2) 

£17. The evaluations and i^e-evaluations. provide 
clear, relevant information which 'assists 
in enabling the school-based commiitei^/ 
administrative. placement committee to make 
decisions regarding instructional services. (2'.4.3) 

* ' 

El 8. The evaluations and rej-evaluations provide 
clear, relevant informition which assists 
in enabling the school f based committee/ 
administrative placement commi ttee-. to make 
decisions regarding related services. (2.4.4) 

* r 

El 9. The annua-1 reviews thoroughly examine such 
information as evaluation data, the I 
' Individualized Education Programs, and 
teacher reports. (2.5.1) \ 

* 

E^O. The annual reviews titoroughly examine 
students' con tinuino el 1qi bill ty for 
special education. (2.5.2) 

E21. 'The ahnilbil reviews thoroughly examine the 
need for ^Ranges in students' instruc- jy 
tional services. (2.5.3) ' i 

,E22. The annual reviews thoroughly examine the 
'need for changes in students' related 
services. (2.5.4) . « 

E23. Jhe annual reviews thoroughly examine the 
continoed appropriateness of students' ^ 
placement. (2.9«5) 

■ ' t ■ 
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E24. The Individualized Education Program state- 
ments of present level of performance are' 
derived from actual formal and informal 
assessment data. (3.1.1) 



E25. The Individualized Education Program annual 

goals and short-term objectives are based 

on identified needs. (3.1 .2) 

E26. The evaluation criteria in the Individual- 
ized Education Proqram objectives are 

clear and usable. (3.1 .3) 

E27. The appropriate types of regular education 

are provided, considering assessment data. (37T7?y 

E28. The appropriate types of special education . 

(e.g., classes for learning d^isabled, 

mentally handicapped) are provided, con- 
sidering assessment data. (3-. 1.5) 

E29. The appropriate types of related services 

are provided, considering assessment data. (371761 

E30. The appropriate types of vocational educa- 

. tion services are provided, considerirtg 

assessment data. (3.1.7) 

E31. The appropriate amounts of*regular 

tion are provided, considering assessment 
data, (a.1.8) 

E32. The appropriate amounts of special educa- <> 

tion are provided, considering assessment ^ 
' data. (3.1.9) 

s 

E33. The appropriate amounts of related services 

are provided, conslclepfiig assessment data.. (3X15) 
• . ■ ■ i ■ ■ ■ 

t34. The appropriate amour>j^§ of vocational , , 

education services a rfr provided, con- ' ^ 

sidering assessment daia. (3.1.11) 

E35: The schools make sufficient personal 
contact with parents regarding progress 
of their children. (3.4.2) 
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Instrument^ F 
Administrator Surve y ^ 



Date 



instructions :' Yhe statements in. ^is survey reflect, various aspects^of 
the school program received by special needs4Fudents . Please assist in over- 
all program evaluation by placing an "X" in the appropriate space-to indicate 
the extent that each statement describes the school program for special needs 
students . Do not include gifted and talented students. Your responses will 
be used only for program evaluation purposes. Return the* completed form to 
^ by' 

Name 



Position 



School ^ 



uyructions to Evaluation Coordinator ; Superintendentg. A^^\^t!int ^mv^^y^ — 
Intenddnts, principals, assistant principals, and other administrators that 
the^LEA feels are necessary should be asked, to complete this survey. Please 
follow through to ensure that fully completed forms are r eturned. ^ 

^ ^ H ■ . — ■> , , ^ « I I _ ■ II -.....,1 ,. ..^ - . ^ 
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F. Administrator Survey 



(U 



Fl. Parents and professionals make responsible 

referrals for those students who are sus- ~ 
pelted pf needtng special education. (2.1 . 1 ) 

F2. The observations prior to referrals contri- 
bute to decision making in the evaluation* 
process. (2 J. 5) 

F3. The referrals accurately reflect the needs 

Identified by the screening data and 
. information from the persons referring 
the students. (2.1.6) 

F4. The evaluations and re-evaluations provide 
clear, relevant education information 
sufficient for determining eligibility of 
students. for special education. (2.4.1) 

F5. The evaluations and re-evaluations provide 

clear, relevant information which assists — 
, in- enabling the school -based committee/ 
administrative placement committee to make 
placement decisions. (2.4.2) 

F6. The evaluations and re-evaluations provide 
clear, relevant information which assists 
in enabT4ng the school -based committee/ 
, administrative, placement committee to 
. make dec-isions regarding instructional 
services. (2.4.3) 

' .. ■ . 

F7. The evaluations and re-evaluations provide 
clear, relevant information which assist*s 
in enabling the school-based committee/ 
administrative placement committee to make 
decisions regarding related services (e.g., 
spetch therapy, counseling, physical ' f 

therapy). (2.4.4) 

► . 

F8. The appropriate types o-f regular educa- 
tion classes are provided, considering 
assessment data". (.3.\ji.4) 

F$. The appropriate types of special education 

(e.g., classes for learning disabled, \ ~ 
mentally handicapped) aire provided, con- 
sidering assessment data.^ (3.1.5) 

FIO. The appropriate types of related services 

(e.g.^ speech therapy, counseling,. physical ' 
therapy) arc provicled, consldlring assess- 
ment data. (3.1.\6) 



- o 
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Fll. The appropriate types of vocational 
education are provided considerinq 
assessment data. (3.1.7) 

F12. Communications from the school to parent 
. are conducive. to building positive 
relationships. (3.4.1) 

V 

F13. The schools make sufficient personal 
contact with parents 'regardinq progress 
of their Chi ld!:en. (3.4.2) 

F14. Parents are a§ked to provide Information 
regarding the placement and educational 
^ planning for their children. (3.4.3). 

F15. Information supplied by parents is con- 
sidered in decision making. (3.4.4) 



(y 
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instrument G 



Student Survey 



1" 



Date 



Instructions to Students : The statements below describe different ways 
you feel about yourself and your schpol. There are no "correct" ansWers. 
Please place an "X" after each sentence to show if you agr^e with what it 
says. • , 



Instructions .to leacher : Select°bd students in your class have been identified 
to complete this survey as part of the overall .sprecial -education program evalu- 
at1on%5 Please help them fill out the survey completely without influencing 
their responses. • In some cases, it may be helpful to read and/or explain the 
questions to students. Be sure they are aware that all responses are confiden- 
tial and will be us:ed only to learn how they fe^ about themselves and school. 
Please return the completed surveys to " by 



• ; 



% > 
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Q. Studeiivt Survey 



I often do things in school with 
my classmates who are not receiving 
special Jielp. (3.2.1 ) 

My school makes me feel good about 
myself. (1.3.1) 

I like many of the people in my 
school. (1.3.2) 

I feel that it is important that my 
school work is finished on time. 1.2.1) 

I like myself. (1.3.1) 



I do my school work the. best I can . (1.2.1) 

I 1 ike my' classmates. (1.3.2) 

School makes me want to learn. (1.4;1) 

I get chosen to do things in school with 
my classmates who are not receivijig 
special help. (3,2.1) 



I liTcB scheol. (1.4.1) 




0 



/ 



0 . 
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RESULTS TABLE SHELLS 
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Instrument H . ' 

Self-Study: Optional PA)cedures to Obtain Additional Information 
for Selected Program Evaluation Questions 
* 

■ Instructions: Many pro ijram evaluatqrs will want to investigate selected 
eva-luation questions in greater detail than Instruments A through G all6v«/.. 
'The material in this instrument is intended to provide guidance to those 
seeking to conduct more. thorough evaluations of special education programs. 

The general approach for this instrument is to appoint a person(s) 
knowledgeable irj special education to. investigate a particular question; 
practical avenues for dfeita collection, inquiry, or analysis are provided. 
Ideally, a team of people would conduct such an investigation under the 
leadership of an individual who is impartial-that is, not an employee of " 
the district. In reality, it is expected that it is the local special edu-' 
cation administrator ^tfo will vojunteer to do the extra work outlined by this 
instrument. The saving strength in this reality is- that the administrator 
who is motivated to- do extra analyses will generally be motivated to take the 
care necessary to obtain. valid findings. 

•Thus, this instrument uses the time-honored approach found in. many accredi 
tation models, the "self-study." 

o 

Each self-study proposed in this instrument is provided on separate pages; 
users should scan the material and decide which, if any, of the studies are ' 
desirable for their particular situations, the general format of self-study • 
can also be adapted for. the study of other evaluation questions. 

■■ ■ - r' ' 
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SELF-STUDIES 



H-1 Reading, Language, Mathematics 

H-2 Vocational Education 

H-3 Follow-up of Graduates 

H-4 Cultural Arts 

H-5 Social Studies and Science 

H-6 Case Study of Referral /Evaluation 

H-7 Severely Handicapped Programming 

H-8 Students Placed Out 

H-9 RreschoorChildren 

.H-10 Students over IB years old 

H-11 Staff Development 

ff-12 Materials and Equipment 

H-1 3 Student Attendance 
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SELF-STUDY H-1 . ' ' . 

READING, LANGUAGE ARTS A ND MATHEriATICS . • . . > 

•When to Use this Self -Study . . \ 

• ■ • ■ ■ T'. 

This self-study provides additional investigation of reading, languag^' arts * 
and mathematics competencies using a comparative evaluation design. It should 
prove, most useful in those cases where conflicting or unexpected results were 
obtained using the standard methods (Records Review and Surveys) with respect 
to readirjg, language arts, and mathematics. 
Evaluation Questions . " 

■ ■■ -f 

The following evaluation questions were addressed by this self-study: 

1.1.1 Are reading competencies attained commensurate with students' abilities 
and handicapping conditions? 

1.1.2 Are language arts 6ompetencies attained commens*«a^e with students 
abilities and handicapping conditions? 

' ■ . . 

1.1.3 Are math competencies attained commensurate with students' abilities 
and handicapping conditions? 

Instructions 

■ 

1. Select three or more comparable North Carolina LEAs, using- the 
following criteria. . 

A. Incidence ;of special rfeeds students wi-thin 1% of your LEA. 

B. A similar proportion of special needs students taking the 
achievement tests in grades 3, 6 and 9. ^: 

G. Comparable achievement test scores for non- special needs 
( students. ~ 

2.,^ompare the scores for each subtest in each area. j 

How to Interprfet Findings ^ • / 

■ I- ' i' ■ ■ .1 -. ■ ■ f 

This provides a numerical siindard for your LEA, with the understanding 

,j ■ ■ ■ ■ ' 

that the "comparable" districts i^iust be similar in terms of special needs student 

population, proportion taking the tests,' and. general LEA studewt scores. Inter- 

pret in terms of success, with the goal of improvement in future years, a 
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' . ' . ■ VOCATIONAL EIJUCATION , 



^ SELF-STUDY •H-2 



/ . When to Use, this $elf>Study : / • ' .' /' . , * * 

V / This self-study sbould prove most useful to those LEA§ wheVe additional 

infohnation is sought regarding the vocational piffepa rati on of specTlaV education 

, Students'.. The self- study compleqients findiT»gs, i'n the basic'\progtJam 'evaluation. 

w Evaluation Questiohs ' ^ " ' 

. The f^l lowing evaluation questions are Addressed by thi,s self-study; . ' 

U1.4' Are vocational .. competencies attained commensurate wfth studentiV . ' 
ab^.1 i ties 2lnd handicapping cohditions? ' 

. ' ' ■ ■• ■ ■ . - «. •■ ■ ■• .■ • 

,i.2.1 " Doei the ipecial education program contribute to the development 
of students' positive work hiib its? . . . " 



Instructions . ..v- * ' 

. ■ '. • * ■ " ■ ^ • * 

1. Appoint an;investigatorik); who wjJlT be responsible -for ^ubmittf^^^^ 
reports jbn the fallowing activities." ' " ' * - . • ; ■ . . 

2. Rev ie,w .Student Individual WHtten Rehab.ili t£|tiol .Programs ' (IWRP ) 
ancjrsxintiiarize.with descriptive itiformati on. Also ra-te ithe IWRP 
for the extents to which it contributes to the above e\talu|itiQh 
questions. Then, determiipe. the extent to which I WRPs; serve the 
total special n eeds popul at fon who could benefit from rehabil-^ - 
itat-fon servides, through interviews of v person involved fe'.g,. , 
the intake process for rehabil Hat ion).' V ; 

* 3. Interview high school students and" their parents regarding the 
* .-two evaluation questions. Use the response format from the surveys. 
' Also, ask. foir;^suggest1ons and general program perceptions. 
*•■ . ' \ ■ . J - 

4. Compare the vocational education roster to the potential number of 
special needs students receiving vocational services, per age group 
(i.e., 16, 17). , 

' • - , ■. 

How to Interpret Findings ^ 




in Y 
loula 



1. The. IWRP descriptive infx)rmat1on should be reported in L table, 
followed by a discussion of the data. Discussion should center 
around eligibility criteria for rehabilitation services, further 
possible use of rehabilitation services, and possible equivalent 
services from the LEA. - , ^ 

2. Interviews should be reported in terms of percentages {%) of satis-" 

^ factory respdnses. Interviewee explanations for the responses shouVd 
also be noted, with particular attention to trends. ^ 
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The discrepancy between actual (roster) and potential vocational 
services should be discussed in terms of curriculum, team decisions 
and long-term student planning. 

' ■ • ■ 

The total vocational experience for handicapped students should be 
discussed in terms pf vocational preparations as a program priority 
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• ' . SEp^-huDY H-3 ■ , 

• F PLLOW-UP OF g raduates' 

When .to Use this, Self-Study ^ \ . 

The follow-up 04^ graduates s]j[)Ul.d be very useful to those LEAs interested 
"in the maxirnum amount of infornmtion regarding student outcomes (the product 
goal- area). ' • 

.It should be' stressed tha-t thi]s is a- very time-consuming self-study method, 
requiring several hundred -flours of searching and interviewing for most LEAs. 
Evaluation Questions ' - ' ' 

The following evaluation questions are addressed by this self^tudy: 

1.1". 4 Are vocational competencies attained commenstrrate with students' 
abilities and handicapping conditions? 

v 

1.1.8 Are competencies for healthful living attained commensurate with- 
* students' abilities and handicapping condi-tlons? . 

. Self-Help Skills/Life Skills x > 

' . Physical Education/Health Education 

• " ■ - \ 

1.2.1 Does the special education program contribute to th^,.development of 
students' positi'vTvtork' habits? • 

1.3.1 boes'the special education program contribute. to the development of 
positive attitudes towards self? 

1.3.2 Does the special ecfucation program contribute to the development of 
positive attitudes towards others? 

' IK. • . 

1.4.1 Does the special education program contribute to students' desire to 
learn? 

' ■ .■ ^ 

Instructions 

^ — -t . 

1. Choose gradUatina class year approximately three years ago for the 
JpVqet group. Make a "list of alrspetial edtre^tion students that 
graduated. Include (but Idbel for data analysis^Npurposes) -dropouts 



,who should be grouped with that class. 



2. Large LEAs may take a true random sample of the class (e.gr>^ne- 
third of the class) to represent the cla^. \^ 

3. Create interv.lew questions for the above evaluation questions (see 
the survey for these iteirts). Add questions such as present job^ job 
satisfaction* commurrity activity, leisure activities, and ^everalxpoen-^ 
ended questions. Train one or two 1ntervj.ewer(s) on impartial intpK^ 
view techniques. ■ ^ 



Ihstructtons > icQirf^) 




H-3 



4. Find the graduates and conduct personal (or telephone) intervi-ev/s 
ll^s important to follow-up and interview as high a 'proportion of 
\ the ntended group '(or sample) a^POssible, 'since a low return would 
^ ilKely bras results. Try again andx^gain'to reach all of the group! 

How to Interpret Findings 

1, Present the results in tables/by area of^^eptionalitj^ and place- 
ment. Separate and compare dropouts and .gradbites. 

2. Total up the estimated annual incomes for the gractuates^ Discuss 
in terms of accomplishment and in. terms of projected\fulKemDlov- 
ment of the jcla^s.. .\ \ 



^- ^JJ^j^y describe where^the students live- have th^y' moved oXo\the 

4. Discuss investment in edkation in terms of jobs, taxRayers. a'nd 
, goo* citizens. \ r\ j * 



\ 
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SELF-STUDY H-4 



CULTURAL ARTS 



When to Use this Self-Studf < , 

^ 

' When additjonal infohnatioh is sought on. program effectiveness in the 
.^ultural arts, a person or team should be assigned to investigate this area. 
luatibn Questions * 
The following evaluation question is addressed by this splf-sti^dy: • 



r 



1,1.7 ' Are cultural arts competencies attained commensurate with studfents' 
abilities and handicapping conditions? 

* InstrQctiyis • 

1. ?\ committee made up of special education personnel with expertise -, 
in the arts should develop an interview guide. The guide should 
be differentiated, on some points, for different age level students. 

■ ♦ ■ 

o'-a. List-tar?get interviewees, inclu^fing appropriate staff members, students, 
anfl parents: Sample as necessary. 

> 

3. Provide training on appropriate interview techniques for the inter- 
viewer(s). 

4- Conduct the interviews; alsp^c^olle^^^^^^ Ppen_-?nd^4 Jiiformation. 

5» Possible Extra Procedure: In-depth interview of a successful case 
story. . . ' 

* « , • ■ ^ • 

How to Interpret Findings . - » 

1. Present the resull^in tables. * , - ' 

2. If the "successful case study" was done, develop realistic numbers 
of students that' could also demonstrate success- in the arts. 

♦ , 

3. Discuss finances in terms of student potentiail and broad educational 
* goals. , ' ' 



5^ 
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• SELF-STUDY ll-^ 
' . SOCIAL STUDhS AND SC^^NCE 

f ■■*»«■ i 

When £o;Use this Self -Stud y ^ . / 

' When* additi Glial inljjicmatlon is sought on program ^ffectivfeiless ln# 
areas of social studies and science, a person oV tearn shou^l be iissign^d to 
Investigate this area. ... 
Evaluation' Questions * 

The following evaluation quwstions are addressed by, this self-study: 

^ '» 

U1.5* Are science competencies attained commensurate with students' 

abilities and handicapping conditiorts? ' ' 

1.1.6 Are social s^tudies tfompetencies attained commensurate with students 
abilities' and handicapping conditions? 

Instructions 

* 1. .Study and describe LEA curriculum and obtain data regarding the 
.number of special education students directly participating in 
'the regular curriculum. 

2. Develop survey questions (to be added to the teacher surveys) 
or Interview guides. The items should reflect student outcomes • 
and regular/special education curricujum coordination for various 
grade levels. ' 

\3. Collect the data (survey or interview) using proper sampling,, 
administration and/or interview techniques. 

- ' ) 
How to Interpret Findings 

1. * Present th? results in tables by age group. ^ 

2. Discuss in terms of: ^ . . • 
, . Student outcomes * | • 

. . Curriculum implications 

. Ma instreaming implications 

•;- ;■■ ■ , ■ - . 

3. / DHcyss the relationship of these areas to reading and to vocational 
Ta'ratia^H..; 




• SEL$.STaDY H-6 ' . 
• . ^ CASE-STUDY OF RE FERRAL/.E VALUATION 

When -to Use this Self -Study , 

.In those cases where the survey instrument/ (or other information) 
suggest functional problems inithe referral/evaluation prjocess. a more 
'Jn-depth look^at individual cases is sug^sted. This is a time-consuming 
self-5tudy. and should only be attempted when a problem in this area is; 
evident and further information i*s necessary before improvements can be made. 
Evaluation Que$tioi)s 

The following evaluation questions are addressed in this self-studyf 
through 2.4.4 (see Manual). 
Instruction s 

1. List all students referred during a specified period (e.g., the 
. last school year). Divide 'the 1 ist into two columns: those 

students who , we re placed in special education and those students 
who were no,t placed in special. education . Use random sampling 
to reduce each column to 15 cases (or to 25 cases for large LEAs). 

2. Assign case investigators who can be impartial. One case investi- 
gator should have cases from both columns described above. Exper- 
tise in Special Education is an essential ingredient. 



3. Investigators should compose a checklist and recording Sheet, 
based on the evaluation questions. 

4. Investigators should read the students' records and interview all 
.people involved with the referral /evaluation process. The open- 

Snded question "why" should be asked in a non -threatening, researcK 
anner for each question. Repeat interviews may be necessary aff6^ 
additional questions are generated by the first interview. 

How to Interpret Findings . i 

'■ to ■ ■ ■ ^ 

1.* Describe the results in two tables, one table for cases that resulted 
in special education services and one for cases that did not. Do 
not combine. the results. 

^ Anecdotal descriptions of selected cases shoufd be developed to make > 
key points. 

3. Analysis should be provided In terms of the quality and effectiveness 
of the profess Iqnal process In producing the Intended results (evalur 
atlons and placements). Emphasize the quality of decisions rather than 
compliance with mandates. Do not fault Individuals If there are 
•problems; rather, focus on processes and actions. 



SELF-STUDY H-7 
SEVERELY 'tiANDI CAPPED PROGRAMMING 



.J 



When to ,U$e this Se1f>Stud,y 

When an lEA serves severely handicapped students directly, additional " 
information regarding the effectiveness of such programs should be sought 
through self study. 

Evaluation Questions • , . * . • 

♦ 

Based upon the program'^ objectives, evaluation questions, shofcild be 
developed. • , ' • * 

Use the format and styl^ found in this manual, as appropriate. 
The following are suggested as areas for program objectives if such . 
objectives need to be developed: 

• . student acquisition of sktlls (mobility, motor development, 
socialization, daily living, health, and communication). 

. Suitable curriculum (comprehensive, longitudinal ,• usable). 

. Appropriate materials (age appropriate, related to curriculum). 

. Proper teaching strategies (DO NOT duplicate staff evaluation efforts). 

. Coordinated service delivery (Include coordination with- residential 
services and therapy as appropriate). 

Instructions . ' 

1. Develop survey or interview items based on the evaluation questions. 
Fl^ld test the items on a few people who will not actually be respondents. 

2. Search for additional methods % answer the evaluation questions, 
such as folder review arwl statistical data, 

• 3. Collect data, using methods parallel to those in this manual. 
How to Interpret Findings ^ ^ 

1. Provide statistical resjiUs' in tables and graphs. 

2. Discuss the results In a format comparable to that described in 
this manual. 

i , 
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SELF-STUDY H-8 

r 

STUDENTS PLACEJ) OUT 



4l 



When to Use this ^^elf-Study * 

/In those cases where additional infoiinatio"Tj is desired regaMing .students 

placed out of the LEA a se],f-study can provide the needed infor*mation. 

« 

Evaluation Questions * 

Additional program objectives and evaluation questions should be created. 
The following are suggested ^''^p'^' * \^ 

. ([Qality of placement decisions; ^ ^ 

. Student outcomes^ . 

. Plans for return tOythe LEA; and ' 

. Qua'lity ot program oversight from the LEA. 
Instructions . 

1. Use data collection methods comparable to those in the manual. 

2. Conduct interviews with team members who have placed children out , 
of the LEA. Site visitations to receiving schools can provide use- 

fyl information. 

3. In-depth study of a few cases (to illustrate different, reasons for 
out placement) should yield information to complement fepresentative 
data from interviews and surveys. 

How to Interpret Findings 

A format for results and interpretation similar to that in the manual should' 

be used. Information on cost ijnplication might be included. • 
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SELF-STUDY H-9 
PRESCHOOL CHILDREN 




When to Use this Self-Study . ' 

I 

When the LEA provides a preschool program for handicapped' chi J dilen 7a 
sfelf-study can measure program effectiveness and suggest program impr;<j<emen 
Evaluation Questions 

Program objectives and' evaluation questions for the preschool program 
should be developed tty adapting the material's in this manual th reflect the 
mission of the prescffiool program. Quality indicators for unique service 
delivery models (e.|: . homebased, 'consultation) should be included. Long- 
term outcomes should also be included to the extent that' they are program 
objectives. 

m 

t 

Instructions *• . 

1. Adapting materials from this manual, de\4elop instrumentation to 
, reflect preschool program objectives. If the program has distinct 
components, they should be treated as separate units for analysis. 

Employ proper sampling techniques and administer the Instruments. 
How to Interpret Findinf|s 

1. Present the results withNtables and graphs that emphasize outcofne 
objectives. V 

2. If possible, discuss in terms of program costs and future cost 
savings for special, education. 



SELF-STUDY H-10 

STUDENTS OVER 18 YEARS OLD ^ * 

^ ■ . • ; — 

When to Use this Self-Study 

/ ■• ■ ■'. . ■ ■■ ' 

When the LEA provides programs to sti^ents over 18 years old, a self -study 

, . ■ '4 ■' ■" 

in this area can tnpasure program effectiveness and suggest program in\provements. 

Evaluation Questions I » 

Many evaluation questions from this manual apply to this group. In addition 
unique program objectives (e.g.", dropout rate, vocational skill training) can 
generate evaluation questions to be addressed for this program area. 

.V. 

Instructibns 

1. Adapting materials ftom this manual, develop instrumentation to 
reflect program objectives and evaluation questions for this - 
area. Consideration should be given to student interviMS as a 
useful instrument. ~ 

2. Employ proper sampling techniques and administer the instruments. 
How to Interpret Findings ^ 

1. Add descriptive results (e.g., skill training areas) to tables . 
and grdphs, to emphasize program intent. . 

2. If possible, discuss findings ot^terms of program continuity 
with- the rest of the special education program, and provide cost * 

^ data. ' 
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SELF-STUDY H-11 

. . ^ STAFF DEVELOPMENT 

: • to 

When to Use this. Sel f-Study . ' 

When an LEA needs to identify the effectiveness of staff development, a 
self-study can provide tlje needed Information. 
Evaluation Questions ^ ' 

The following evaluation questions are suggested tor this self-study 

for an (optional ) program objective of Improving staff competencies and 

■ ». - ^•'■• 
att1tudes: 

. Are staff competencies Improved as a result of Iniervlce activities? 

.Are staff attitudes improved as the result of insurvice activities? 

,. Are inservice activities systematically designed p address staff 
competency needs? ' [\ 

» . 

. Are inservice activities systematically designed to Improve staff 
attitudes? 

Instructions ' 

, 1. Review the above evaluation questions a'ncNr'evise as necessary. 
-For more detail, the competency areas and attitudes can be 
specified. Also, various program components within staff develop- 
ment (e.g., workshop series, "Wednesday seminars," department 
newsletters, inservice day) can be specified. Long-term vs. 
short-term effects may also be addressed i 

2. Instrumentation should be developed to measure program evalu- ' 
ation questions. If data is collected on an ongoing basis, 
(i.e., for evaluation of each worksliop or activity),* such existinq 
information should be used first. 

I 

How to Interpret Findings 

Present the results succinctly in a table. In narrative, describe the 
staff development program activities. Staff development costs' should also 
be described, and related to the, overall special education budget (e;g., U). 
Time spent by staff should also be considered in discussing staff development 
prog^rairt effectiveness. . 
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. . SELF-STUDY H-1 2 

> . MATERIALS AND EQUIPMENT 



of Public 
hoQl Units in 



When to Use this Self -Study . 

When an*LEA needs e^^Swation information regarding materials and equip- 
ment, a self^study can provide needed evaluation information. 
Evaluatiog Questions ' \^ * 

Evaluation questions can be derived from the Departmen^ 
Instruction publication "/program Descr4ption for Use by S( 
S£ate Accreditation and Programming Planning: Exceptional ^(jhildren's Programs 
Questions should emphasize the degree to which materials ajid equipment are 
effective instructional aids. 
Instructions ' 

1. Develop evaluation questions an(i inslrumeHt items. 

2. Investigate existing sources of data (e.g. » accreditation. reports; 
equipment inventories). ' . 

3. Consider sharing information among the LEAs for (per-pupil) compar- 
isons. 

4. Collect data. 
How to Interpre^ Findings 

Present descriptive information such as annual expenditures and inventory 
along with effectiveness results. Interpret in terms of satisfactory use of 
resources. * 
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SELF-STUDY H-13 

% 

. STUtolT ATTENDANCE l 

When to Use this Self-Stu Bv 

When 1Y\^onnat1^rirelating to student attendance would be helpful in 
assessing certain program objectives, a self-study for student attendance 
'should be conducted. ^ 
Evaluation Questions 

The following evaluation questions are partially addressed by this 
self-study: j- ... 

1-1.4 Are vocational competencies Attained commensurate with students' 



abilities and handicapping conditipns? 



1.1.8 Are competencies for heal thfuli 1 iving attained coinnens urate with 
stu|ients abilities and handickpping conditions? 
. Self-Help Skills/Life Skills 
. Physical Education/Health Education 

1.2,1 Does the ^special effluS^i on program contribute to the developrrfent 
pf students' positive Work habits.? i 

1.4.1 Does the special education i)rogram contribute to students' desire 
to learn? ^ 

Instructions 

1. Collect ^student attendance information, for each unit of ana^sis^J'^ 

2. Gather in-depth information by interview or record search to deter- 
mine the reasons for any attendance problems, . ' 

* . f 

3. Comparative data, for regular education or other LEAs, may prove 
valuable in some cases where results are difficult to interpret in 
isolation. ^ 

How to Interpret Findings . * 

* 

Descriptive results should be provided for each linit of analysis. Th? 
reasons for attendance problems should" be described. The degree of relation- v . j4 
ship tp each of the four (4) evaluation questions should be discussed* noting 
the limitation that usually several variables affect students' attendance. 
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APPENDIX 



RESULTS TABIE SHELLS 
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\ TABLE SHELLS 

^ INSTRUMENT A 



DATE: 

^ 



Survey -results are cJitegorized into four (4) groups: EXCELLENT^ SATIS- 
FACTORY. UNSATISFACTORY. AND NOT APPLICABLE. 

This table shelli displays the percent of satisfactory or better responses, 
Cbmpute this by dividing the numbet^ of SATISFACTORY anci EXCELLENT responses, 
by the total number of EXCELLENT. SATISFACTORY, and UNSATISFACTORY responses. * 
Do not include the NOT. APPLICABLE response^B in calculations. 



NOTE: If a mpre detailed analysis is desired, extra copies of Instrument A ^ 
may be used as a table or the table shell may be modified. ^ 

f 
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INSTRUMENT A: Student Record Review 
TABLE SHELL 



% of Satisfactory or Better Responses by Exceptionality. Student Setting & LeveJ 



Questions 



The referral accurately re- 
fleets the needs identified by 
the screening data and infor- 
mation jfrom the "t)ersons refer- 
ring tl/e students. (2.1.^) ' 



U> Q 



CD ai 

MS 



o 
-kl. 



JO. 



o 

Ul 



The ^valuation/re-evaluation 
addresses the needs identified 
in the referral • and/or other 
relevant data' (2.2.1) (2.3.2) 



The referral provides useful 
information that assists in 
the selection of evaluation 
instruments and techniques. 
»(2.3.1) ' 



A4. The techniques qsedyln con- 
• ducting evaluation/re-evalu- 
ation take into accouni such 
student considerations as age, 
disability, , and native 
language. (2.3.3) 



There is concrete evidence 
that the annual review has 
thoroughly examined such ih- 
^tormation as^evaluation data, 
the Individualized Education 
Program and other relevant 
data to determine the appro- 
priateness of continued place- 
ment and/or related services. 
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INSTRUMENT AL Student Record Review 
' TABLE SHfLU 

% of Satisfactory or Better Responses by Exceptionality. Student Setting & Level 



Questions 



All. The Individualized Education 
Program^ goals and short-term 
objecti ves are based oh 1 
tifled needs. (3.1.2) 



A12. Evaluation criteria in Indivi 
dualized Education Programs 
are clear and usable. (3.1 .3) 

The appropriate types of regu- 
lar education a rp .provided, 
considering assessment, data. 
(3.1.4) 



A14. The appropriate types of 

special education are provided, 
considering assessment data. 
(3.1.5) 



The appropriate tfpe% of 
related services are provided, 
considering assessment data. 
(3.1.6) 




JO. 
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^ to 

SCLSb. 



t/1 



JO. 



s 



A16. The appropriate types of 

vocational education serv.lces ' 
^ are provided, con^ldfirJug _ - 
as-s*ssment dala . (3.1.7) 

AU. The approprilite anipunJts of 
regular education are provided, 
considering assessment data. 



(3^.1.8) 
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' INSTRUMENT A: Student Record Review 
mil SHELL 



% of Satisfactory or Better Responses by Exceptionality. Student Setting & Level 



Questions 



/VI 8. The appropriate amounts of 
special education are pro- 
^ Wed , considering asseksmef) 



data. (3.1.9) 



"'~>f'^1'§T°-The""appwpT^^^^ amounts of 

related serviices are provided 
considering assessment data. 
(3.1.10) 

A20. The appropriate amounts of 
vocat1onal\jeducation services 
are provided, considering 
^ assessment data. (3.1. Ill 



A21. The documented evidence from 
-^the school to parents indi- 
cates that the contact is 
conditfive to building posi- 
tive relationships. (3.4.1) 

A22. Reading competencies are 
attained commensurate with 
students' abilities and ' 
handicapping conditions. 
(1.1.1) 



A23. Langua.ge artdUompetencies 
are attained obmmensurate 
tnn students' abilities and. 
handicapping conditions. 
(1.1.2) /' 
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INSTRUMENT A: Student Record Review 



^ ^ TABLE SHELL ' 

% of Satisfactory or. Better Responses by Exceptionality, Student Setting & Level 



Questions 




Q 










OTHER 
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nam competencies are attain- 
ed commensurate with stu- 
dents' abilities and handi- 
i capping conditions. (1.1.3) 
































vn 
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J^ZS. Science competencies are 
attained commensurate with 
'Students' abilities and , 
handicapping conditions. 
(1.1.5) 






• 








1 


c 


















A26. Social studies competencies 
are attained commensurate 
with students' abilities end 
handicapping conditions. 
(1.1.6) 

A 


• 
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J 
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A27. Competencies in the Cultural 
arts are attained coninen- 
surate with students' 
•abilities and handicapping 
s. conditions. (1.T.7) 

"^V~^ — ■ — ■•' ■ 










' - 




















- 


• 


Aiwr\ Vdcatlonal education qom- 
< 1 Y®^®"c^®S are attained com- 
1 tiensurate with students' 
Vi'btli ties- and handicapping 
^conditions. (1.1.4) 

' ' ■ i'*- r -1 III 
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,A29. Competencies In self '•help/ 
life skills are attained 
commensurate with students' 
abilities handicapping 

o ...:,<^.')<»lt1pns.,..,,(T...l,«} „ „..,. 
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. INSTRUMENT A: Student decpH Review 
^ TABLE SHELL 

%'Of Satisfactory or Better Responses by Exceptionality. Student Setting & Level 



Questions 



A30. Competencies in pHysIca] 
education/health education 
are attained commensurate 
with students' abilities and 
handicapping conditions. 
(1.1.8) 
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Date: 



TABLE SHELLS 
INSTRUMENTS B, C, D. E. F, AND G 



Survey responses are categorized into four (4) groups: 
"EXCELLENT, SATISFACTORY, UNSATISFACTORY. AND NOT' APPLICABLt. Suggested 
data combinations for niost users are: 



. EXCELLENT 


•"••1 


SATISFACTORY 




More than 








Adequate 




Adequate 





UNSATISFACTORY 



Less than 
Adequate 



Not At 
All 



NOT APPLICABLE 



NOT APPLICABLE 



These table shells display the percent of satisfactory or better responses. 
Compute this by dividing the number of SATISFACTORY and EXCELLENT responses by 
the total number of EXCELLENT, SATISFACTORY and UNS/^TIS FACTORY responses. Do 
not include the NOT APPLICABLE responses in calculations. 



NOTE: If a more detailed analysis is desired, extra copies of Instruments may 
' be used as a table or table shells may be modified. 
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, ; INSTRUMENT B: Parent Survey 
( TA$LE SHELL ' 

% Of S^ilsfactory or Better Responses by Exceptionality, Student Setting & Level 



INSTRUMENTS;. Parent Survey 

■ ■ . o 

/ TAeiE SHELt 
Better Responses by Exceptional Hy.^ Student Setting & 



. INSTRUMtm B; Parent Survey 
• TABU SHELL 

% Of satisfactory or Better Responses by ExceptlonaU^. Stud^t Setting , Level 



Questions 



B18. The yearly Individualized 
Education Program meetings 
consider whether my child is 
getting .the right special ^ 
help. (2.5.5) • * . 



819, The regularf school programs 
help mychitd .in the way he/ 
she behaves and gets along 
with others. (3.2.1) 



820, The regular school programs 
(3 3 1)^^'^ school work. 




821. The conferences, phone calls 
and letters from, the school 

. . help the school and me 
work together. (3.4.1) 



822. The school keeps me informed 
about my child's progress. 
(3.4.2) ' , 

.323. The school asks me for InfqrJ 
•nation about planning my ' 
i(3^4*^3) ^^^^^^ P'^gram. 



^24. The school uses the infor- 
mation thatN I give them to 
^plan mv child's program. 
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INSTRUMENT C: Special Education Teacher Survey , 

TABLE SHELL ' 

% of Satisfactory or Better Responses % Student Setting & Level 



CI 



Questions 

Reading competencies are attained commensurate with 
students' abilities and handicapping corklitions 



iifrXfnJf.'TfJ!?''^®' attained commensurate 
with st^ents abilities and handicapping conditjlons. 



C3. Math competenc]Bvare Attained commensurate with/ 
(1 1^3) ''^^^^^^^^^^^"dicapplng conditions? 



cJ.!SS^?.f**'"£???;?^^' ^''^ atVfned comnensurate with 
0 15) "'^-^/^^^^s.and handi^^ping conditions, 



C5. Social studies competencies are atta^ed commensume 
(11.6) ' '""^ handlcap^nrcStLs- 



C6. Cultural arts competencies are attained comnensurate 
JJ"^«"tsV.ab11it1es 4nd handicapping SiSns. 



C7. Vocational education competencies are attained ' 
cofrmensurate with students' abilities and handi:^ 
capping conditions. (1.1.4) . 



08. Self-help skills/life skills competencies are \ 
attained cofwnensurate with students' abilities and 
handicapping conditions.* (1.1.8) "i^ies ana 

- * 
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INSTRUMENT C: Special Education TeacheriSurvey ' 
> ^ . , / il^lE SHELL 

% of Satisfactory or Better Responses by Stu<|ent Setting & Level 



Questions 



C9. Physical educat ion/ health education conoetencies are 
attained coirmensurate with students' abilities and 
^andlcapp^ing conditions. (1.1.8) 



J — 1 — — ^ ■ 

CIO. The special education program contributes to the 
" develo^nt of students' positive work habits. 



Cn, the special education program contributes to the 
develooment of positive attitudes towards self. 



C12. The special education program contributes to the 
yjvelooment of positive ^titudes towards others. 



C13. The special education program contributes to students 
\des1re to learn. (1.4.1) 



C14. Students who are Included In regular education 
b6^efit> socia'lly. (3.2.1) 



"T—^ ""X" — — 1 ^ — w.... ff. 

C15. Students who are included in regularVeducation. pro 



graipMenefU academically. (3.3.1) | 



C16. Parent^ and professionals make responsible referrals 
for' thoy students who' are suspected of needing 
special Wucation. (2.1.1) . 



\^ ' ■ — — V I i n I f ii I . ■ I I . . _ 

Siili*"!" 55*^ may^be^in need of special education are 
^ i^^^^A « . ^^^^^ as should 



^referred f6r Individual screening 
be expected/- <2.1.2) 
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INSTRUMENT C: SpeciaT Education Teacher Survey 

TABLE SHELL 

% of Satisfactory or Better Responses by Student Setting & Level 



Questions 



C13. 



iH^n^f r IJ^^ ^'^ ^"^^P screenings are effective 
in Identifying those students who should receive 
further. screening or evaluation, (2.1.3) 



C19. 



IIlLflf?I"2^^°"{r^"^^^^"3*^°" addresses the needs 
- . data (2 2 1) ^e^^rral and/or other relevant 



C22. The techniques used in conducting evaluaVion/re-evalu 

A^^Hn Iff ^"^^ student considerations 

as a§e, disability, and native language. (2.3.3) 



l^rlJ^J.^V'^'iV^i^'^ Education Program statements* of 
. performance are derived from actual 

^o'^^' Informal assessment data. (3.1.1) 



C24. The Individualized Educati6n Program annual goals 
needs (3'l*2j ^^'^^^^^^^^^^''^ ^^sed on identified 



C25. The evaluation oriteria lH||he Individualized 

(fli)^" ^''09''«'",ot>Je«tives are clear and usable; 
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INSTRUMENT C: Special Education Teacher Survey 
— TABLE SHELL 

% Of Satisfactory or Better Responses by Student Setting & Level 



Questions 



3 , „. ■ A 
roprlate types of regular education classes 
provided, considering Assessment data. (3.1.4) 



C27. The appropriate types of special education (e.g. 

classes for learning disabled, mentally handicapped) 
are provided, considering assessment data. (3.1.5) 



C28. Ttie appropriate types of related services are provided 
considering assessment data. (3.1.6) 



C29. The appropriate types of vocational education are 
provided, c onsidering assessment data. (3.1.7) 

C30. The appropriate amounts of regular education are 
provided, considering assessment data. (3.1.^) 

eai. The appropriate. amounts of special education are 
provided, consideriug assessment data. (3.1.9) 



19 O I t3 C£ 

^,5 ^S- 



G32. The appropriate amounts of related services are 
provldedj; considering assessment data. (3.1.10) 



C33. The appropriate amounts of vocational education 

^(V^Vu \ P'^vided, considering assessment data. ' 



C34. The school, has sufficient p^sonal contact with \ 
parents rega rding progress oT their children. (3.4. 2)\ 

C35./ Informajplon supplied by parents is us^d in decision 
making. (3,4.4) 



\ 
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mSTRUMENT D: Regular Education Teacher Survey 



Dl 



D2. 



D3. 



04. 



TABLE SHELL 

% of Satlsfactopr or Better Responses by Level 



Questions 



Reading competencies are 
attained commensurate 
with students'<*abilities 
and handicapping condi- 
tions. (1.1.1) 



Languag^^rts compe- 
•tenci.es are 'attained 
commensurate with stu- 
dents' abilities and 
handicapping conditions. 
(1.1.2) *^ 



Math competencies ar6 
attained commensurate 
with students' abiliti 
and handicapping con- 
ditions. (1.1.3) 



05- 



Science competencies are' 
attained commensurate 
with students' abilities 
and- handicappihg con- 
ditiohs. (1.1.>5) 

Social studies compe- 
tencies are attained 
commensurate with " 
sjtudents' abilities and 

handicapping conditions. 
(1.1.6) , 




Questions 



2 



UJ 
Ul 



UJ 

to 



D6. 



Culturai..j#ts competencies 
are attained commensurate 
with students' abilities 
and handicapping condi- 
tions. (1.1.7) 



07. Vocation&l education com- 
petencies are attained 
cqmmensurate with studeot's 
abilities and handicapping 
conditions. (1.1.4)' . 



D8. 



Self-help skills/1 life- 
skills competencies are 
attained commensurate 
witd student^' abilities 
and handicapping condi- 
tions. (1.1.8) 



D9. ;Phys1cal, education/ 

health education compe- 
tencies are attained 
I commensurate with stu- 
dents' abilities and 
handicapping conditions. 

(ij.et 



DIO. 



The\speclal education pro- 
grarrt, contributes to the 
development of students' 
DOS 1t\lve work habits. 
(1.2.U 
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INSTRUMENT. D: Regular Education Te'Sicher Sur 



TABLE SHELL 

% of Satisfactory or Better Responses by Level 



Questions; V; 

Oil. The special education 
program contributes to 
the development of posi 
tlve attitudes towards 
self. (1.3.1) 



012. The special education 
program contributes to 

- the development of posi 
tlve attitudes towards 
others . (1.3.2) . 

013. The special Education 
pr'ogram contributes to 
students,! desire to^ 
learn. (1.4.1) 



Studfrnte who are included 
in regular education 
rrams benefit socially 



)ro( 



«^ I Wll \ I I 

015. Students who are Included I 
ifi regular educatljpn pro- 
oV*ams benefit academ- 
ically. (3.3.1) 



of 6. / The mass screenings 



or 



sif^eep screenings a r*e 
effective in identifyinq 
49 - those students who 
^ should receive further 
screening onevaluation. 
(2.1.3) f 



Questions 

D17. Pre-referral conferences 
provide effective altern- 
atfves to special educa- , 
tion which allows students! 
to succeed in regular 
education. (2.1.4) 



018. 



019. 



Observations prior to 
referrals contribute to 
decision making in the 
evaluation process. 
(2.1.5) 

The evaluations and re- 
evaluations provide clear, 
relevant Information 
which assists in enabling 
the school -bftsed/adminis- 
trative placement commit- 
tee to make deplsions 
regarding instructional 
services. (2.4.3) 



020. The Individualized Edu-' 
cation Program annual 
goals and short-term 
objectives are based on 
Identi fied needs. (3.1,2) 

021. The evaluation criteria 
In Individualized Edu- 
cation Pr'ogram objectives 
are clear and .usable. 
t3.1.3 



INSTRUMENT D: Regular Education Teacher Survev 



TABLE SHELL 

% of Satisfactory or Better Responses by Level 



. Questions 



022. The appropriate types of 
regular education classes 
are provided, considering 

assessment data. (3.1.4)" 

« ^ L- 



023. The appropriate type$ of 
Sipecial education (e.g., 
classes for learning dis 
abled, menta-lly handi- 
capped) are provided, 
considering assessment 
data. (3.1.5) 



024." The appropriate types of 
j ' related services (e.g. 

^eech therapy, counsel - 
, ^ng, physical therapy) 
'^are provided, considering 
assessment data. (3.1.6) 



02^ The appropriate types of 
vocational education 
servlces^are provided, 
considering assessment 
data. (3.1.7) , 



026, 



The appropriate amounts 
of regular education re 
provided, considering 
assessment data. (3^1 .8) 



ERJC 



4«t 



jL 



uS o 



o 

Ul 

on 



^Questions 



027. The appropriate amounts 
of special education are 
provided, considerina 
assessment data. (3.1.9) 



028. The appropriate amounts o 
related services are pro- 
vided, considering assess 
ment data*. (3.1.10) 



029. The appropric|te amounts o 
vocational education ser- 
vices are provided, con- 
sidering asses$ment data. 
(3.1.11) . 

f 



030. The schools make suffi- 
cient personal contact 
v/ith /parents regarding 
•pronress of their chil- 
dren. (3.4.2) 



031. Parents are asked to pro< 
vide information regard- 
ing the placement and 
. educational Planning for 
their children. (3.4.3) 
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INSTRUMENT ,E: Related Services Staff Survey 

i 

TABLE SHELL 

% of Satisfactory or Better Responses by Level 



El 



E2, 



E4. 



Questions 



The special education 
program contributes to 
the development of posi 
tive attitudes towards 
self. (1.3.1) 



The special education 
proqram contributes to 
the development of posi- 
tive attitudes towards 
others. (1.3:2) 



S o 



E3. The special education 
nroqram contributes to 
students' desires to 
, learn. (1.4.1) 



SpeclfT education stu 
dents included in reg- 
ular education programs 
benefit socially. (3.2.1) 



E5. PJirents and professionals 
^make approorlate refer- 
rals fov those/students 
who are suspected>f 
needing special educ- 
ation: (2.1.1) 



Children who may be In 
need of special ejlucatlon 
are referred for Indivi- 
dual screening as early 
as should be expected. 



O 

to 



Questions 



LU O 
-» »- 



E7. Mass screening or sweep 
screenings are effective 
in identifying those stu- 
dents who should receive 
further screenings or 
evaluations. (2.1.3) 



E8. Pre-referral initial con- 
ferences provide effective! 
alternatives to soecial 
education which allow stu- 
dents to succeed in reg- 
ular education. (2.1.4) 



E9. Observations prior to" 
referrals contribute to 
decision making in the 
evaluation orocess. 
(2.1.5) 



ElO. Referrals accurately 

reflect the needs identi.- 
f led by the screening ' 
data and Information from 
the persons referring the 
student. (2.1.6) 



Ell. The evaluatlon/re-evalu- 
atlon addresses the needs 
Identified In the referral | 
and/or other relevant 
data, (2.2.1) 



i 



INSTRUMENT £; ReUted Services Staff Survey 



TABLE SHELL ■ • 

t of Satisfactory or Better Responses by Level 



Questions 



m. 



Referrals providp ..useful 
inforniation that assists 
in the^selection of evalu- 
ation jjistrufn^nts and 
techniques. (2\3.1) 



E13. 



All needs identified in 
referrals are addressed 
by evaluation techniques.' 



E14. 



at 



The techniques used in 
conducting evaluations/ 
re-evaluation§ take into 
account such student 
considerations ^s age, 
disability, and native 
language. (2.3.3) 



E15. 



The evaluations and re* 
evaluations pK)vide clear 
relevant education infor 
mation sufficient for 
determining eligibtlity 
of students for special 
education. (2.4.1) 



E16. 



.^5 




The evaluations and re- 
evaluations provide clear 
relevant information 
which assists in enabling 
the school-based commit- 
tee/administrative place- 
ment cofflmittee to make i 
Macernent decliinns (9 4'?) 

. '"" .."J!i.' ll"' >llMll>MII III llAffi iii7i'ii.i iifiili 




Questions 



The evaluations and>e- 
evaluations provide, cle^, 
relevant iilforniation which 
assists in enabling the 

• school -based committee/ 
administrative placement 1 
committee to make decisioni 

. regarding -instructional 
services. (2.4.3) ' 



The evaluations and-. r!«- 
evaluations provide clear I 
relevant tnfopiation . 
which assists^in enablim 1 

the school -based, comnit tee 
: administrative olateitient 
committee to^nake deci- 
sions regarding related 

,,seryicesi.. (2.4:4)/..: , * 



E19., 'Jh6 annual reviews thor- 
' 'oucihly^^examine such infor-l 
.mationjs evalu.ation data; 
the Indivlduali^edjduc- 
ationvProqrams, «ind • 
teacher reports. (2.5;1)„ 



E20r The. annua 1 Reviews thor^ 

' opglily examine Students' 

v continuing titliglblMty v; 

for specla:l :educatioh. 
12. 5. ,2/ 



E21 



E22. 



124. 



E25. 



Questions 



The annual reviews thor- 
oughly examine the need 
for changes in students* 
imtructiona) services. 
(2.5.3) 



The annual reviews thor- 
oughly examine the need 
for changes in students' 
related services. (2.5.4) 



The annual reviews thor- 
oug|i]y examine the con- 
tinued appropriateness of 
students' placement. 
(2.5.5) 



The Individualized Educ- 
ation Proqram staitements 
of.oresent level of 
performance are derived 
from actual formal and 
informal assessment data. 



The Individualized Educ- 
ation Program annual 
goals and short-term 
objectives are based on 
identified needs. (3.1.2) 



INSTRUMENT S: Related Services Staff Survey 

TABLE SHELL 

%, Of S.atisfactory or Better Responses by Level 



2=: 

LU 



LU 
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Questions 



E26. The evaluation criteria in 
the Individualized Educ- 
ation Program objectives 
are clear and usable. 
(3.1.3) 



E27, 



The appropriate fyoes of 
r^ular education are. 
provided, considering ' 
assessment data. (3.1.4) 



\ 



E28. The aporopriate types of 
special education (e.g. , 
classes for learniriq dis- 
abled, mentally handi- 
capped) are provided, con- 
sidering assessment data 
(3.1.5) 



E29. 



The appronriate types of 
related services are pro- 
vided, considering assess-] 
ment data.- (3.1.6) 



E30. 



The appropriate types of 
vocational education ser- 
vices are provided, con- 
sidering assessment data. 
(3.1.7) 



O 

LU 
CO 



INSTRUMENT 'Z: Related Services Staff Surye^r. 



ro 



E31 



^32. 



TABLE SHELL 

% hf Satisfactory or Better Responses by Level 



Questions 



T 



The .appropriate amounts' 
of regular education are 
Provided,v considering 
assessment derta. (3.1.8) 



The appropriate amounts 
of special education are 
provided, considering 
asse|sment data. (3.1.9) 



E33. 



E34 



The appropriate amounts 
of related services are 
provided, considering, 
as.sfessmeht da»Ja. (3.1.10) 

L_ — P 



The appropriate -amounts 
t>f Vocational education 
services are provided. . 
considering assessment 
<lata. (3.1.11) 



E35. The schools make suf- 
ficient personal contact 
with parents regardittg 
progress of their chil- 
dren. (3.4.2) 




I 



I 



I 
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INSTRUMENT F: Administraior Survey 
TABLE SHELL 

.% of Satisfactory or Better Responses by Level 



'i 



^ ' > — . 

Questions 


-J 

UJ o 


IxJ 
UJ 


o 


Fl. Parents and professionals 

^rals for those students 
wh<^ are suspected of 
neeiJ4nq special education 
{2.1.TnJ . 




9 




F2i' The obser\;^tions' prior to 

1 refeiTal^- r*f»nt-»»<Kiito 

1 CI laid uyii tr 1 uu ue lO 
\ decision mak^og in the 
evaluation protess. 
1 (2.1,5) 1 \., 




V 




\ — '~ 7"^ " ' ■ ■ '»>'X 

F3. The referrals accur^^ijtely 
reflect the needs identi- 
fied by the screening \ 
data and information froK 
the persons referring 
the students. (2.1.6) 








■ F4. The evaluations and re- 
evaluations provide ^ 
clear, relevant education 
inTormation sufficient 
for de.termining eligi- 
bility of students for 
- soecial education- 
(2.4j) 

Wp"^:^M..,'..,>^....-.. X6 D 




V 





Questions 



UJ o 



F5. The evaluations and re- 
t evaluations provide clear, 
relevant information 
which assists in enabling 
the school -based commit- 
, tee/administrative place- 
ment committee to make 
placment decisions. 
(2.4*2) \ 



F6. The evaluations and re- \ 
evaluations provide clear, 
relj^ant information 
whicV assists in enabling 
the school -base committee/ 
admimistrative placement 
committee, to make deci-. 
sions regarding instruc- 
tionctl services. (2.4.3) 



F7. The evaluations and re- 
evaluations provide clear, 
relevant information j 
which assists in enabling 
^ the school -based cormiit- 
tee/admini strati ve place- 
ment committee to make 
decisions ^reaarding 
related services (e.g. , 
speech therapy, counsel- 
ing, physical therapy), 
(2.4,4) 



o 



INSTRUMENT F; Administrator Survey 



* % of Satisfactory or Better Responses by Level 



TABLE SHELL 



Questions 



F3. 



The appropriate types of 
regular education cTasses 
are provided, considering 
. assessment data. (3.1 .4) 



F9. 



The, appropriate types of 
spetial education (e.g. , 
classes for learning 
¥ disabled, mentally handi- 
capped) are provided, 
• considering assessment 
%- data. (3 J. 5)' 



The appropriate types of 
- related services (e.g. , 
speech therapy, couhsel 
ing, physical therapy) 
^ are provided, considering 
•. assessment data. (3.1.6) 



Fl 1 . The appropriate types of 
vocational: education are 
provided considering 
assessrtient dat;a. (3.1.7) 

fl2. Communications from the 

school to parent Jre 
i conducive to building 
positive relationships. 

162,, f^-"') ... 
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Questions 



F13. 



The schools make suf- 
ficient personal contact 
with parents regarding 
progress of their chil- 
dren. (3.4.2) 



F14. 



Parents are asked to pro- 
vide information regarding 
the placement and educ- 
ational planning for 
their children. (3.4.3) 



F15. 



Information supplied by 
parents- is considered in 
decision making. (3.4.4) 



S o 



INSTRUMENT G; $tudent Survey 
TABLE SHELL 

% of Yes Responses 6y Exceptionality, Student Setti#)g -ii Level 




— ^ 
G7. 



Questions 



'Ql., I often do things In school 
with my classmates who are 
not receiving special help. 
(3.2.1) 



G2, My school makes me feel "good 
about inyself. (1.3.1) 



G3. I tlk^ many of the peopje In 
^ my school. (1.3.2) 



64. I feel that i.t is important 
. that iny school work is 
finished on time. (1.2.1) 



65. . I tike/nyself. (1.3.1) 



66. I like school. (IM.l) 



I do my school work the best 
I can. (1.2.1) ^ 



68. * I jike n\y classmates. (1.3.2)1 



69. . Sthool makes me want to 
learn. \1.4.i) 



610. I get chbsen to do thlng^ 
in school with rry classmates 
who are not receiving 
special help. (3.2.1) 



oc 
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